rA 


AD-762  470 


INFERENCE  AND  THE  COMPUTER  UNDER¬ 
STANDING  OF  NATURAL  LANGUAGE 

Roger  C.  Schank ,  et  al 


Stanford  University 


Prepared  for: 

Department  of  Defense 

Advanced  Research  Projects  Agency 

May  1973 


DISTRIBUTED  BY: 


National  Technical  Information  Service 
U  S.  DEPARTMENT  OF  COMMERCE 

5285  Port  Royal  Road,  Springfield  V3.  22151 


BEST 

AVAILABLE  COPY 


Ad  762470 


STANFORD  ARTIFICIAL  INTELLIGENCE 
MEMO  AIM-197 

CA-  Tv 'S  V> 

/  i. 

INFERENCE  AND  THE  COMPUTER 
UNDERSTANDING  OF  NATURAL 
LANGUAGE 

BY 

ROGER  C.  SCHANK 
CHARLES  J.  RIEGER  III 


SUPPORTED  BY 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
ARPA  ORDER  NO.  457 

MAY  1973 

b/ 

NATIONAL  TECHNICAL 
INFORMATION  SERVICE 

u  0  D*po of 

5pfiogfitlrf  VA  22!  31 

COMPUTER  SCIENCE  DEPARTMENT 
School  of  Humanities  and  Sciences 
STANFORD  UNIVERSITY 

k  ■•'ir  \ 

(§LM  I 


n  n  c 


Ju.Uv 


UUiL-T^U  U 

Q£  > 


Unclasslfie  1 _ 

St-runU  Classification 


DOCUMENT  CONTROL  DATA  ■  R  &  D 

tSerunty  clasuficction  nl  titio,  body  of  *b»fr«rf  and  indexing  Annotation  must  be  anterecf  »f»en  the  overall  report  t %  rlasaifitd} 


2<.  REPORT  SECUR'TV  CLASSI^ICATiCN 

Unclassified 


2b.  C*OUP 


*  Hr  POR  I  TITLE 

INFERENCE  AND  THE  COMPUTER  UNDERSTANDING  OF  NATURAL  LANGUAGE 


a  DEKRiPTivr  NOTE.*  (Typa  ol  report  and  incluxive  dataa) 


_ techni c al  reuor t.  Mav  IQ//’. _ 


s  *u  tmoR'.S)  nimf,  madia  initial,  laat  name) 


?oger  C.  Schank  and  Charles  J.  Rieger  III 


»«.  TOTAL  no.  of  paces  J6.  no  of  refs 

S&5  b'i  9 


fa  COSTfiiCT  G**NT  NO 

SD-183 

b  P  HOJF.  C  T  NO 

ARPA  ORDER  #  457 

9».  ORICiNATOR'*  REPORT  NUMBf  UlS) 

STAN-CS -73-358 

C. 

o'. 

3h.  other  REPORT  NO  (St  (Any  othar  numbers  that  may  be  assigned 
thia  report) 

MEMO  AIM-197 

10  DI3ffil9UTlON  STATEMENT 

Releasable  without 

limitations  on  dissemination 

It  SuOPttMESTIRir  NOTH 

!R.  SPONSORING  MILITARY  ACTIVITY 

*3  *BSTR*CT 


The  notion  of  computer  understanding  of  natural  language  is  examined  relative 
to  inference  mechanisms  designed  to  function  in  a  language-free  deep  conceptual 
base  (Conceptual  Dependency).  The  conceptual  analysis  of  a  natural  language 
sentence  into  this  conceptual  base,  and  the  nature  of  the  memory  which  stores 
and  operates  upon  these  conceptual  structures  are  described  from  both  theoretical 
and  practical  standpoints.  The  various  types  of  inferences  which  can  be  made 
during  and  after  the  conceptual  analysis  of  a  sentence  are  defined,  and  a 
functioning  program  which  performs  these  inference  tasks  is  described.  Actual 
computer  output  is  included 


DD  "".*.,14 , 


Unclassified 

^FCUfitv  CUssificatian 


S/N  0101-  807.6801 


STANFORD  ARTIFICIAL  INTELLIGENCE  LABORATORY 
MEMO  AIM-197 


MA\  1373 


COMPUTER  SCIENCE  DEPARTMENT 
REPORT  NO.  CS-358 


INFERENCE  AND  THE  COMPUTER  UNDERSTANDING 
OF  NATURAL  LANGUAGE 

by 

Roger  C.  Schank 
Charles  J.  Rieger  1 1 1 


ABSTRACT:  The  notion  of  computer  understanding  of  natural  language 
is  examined  relative  to  inference  mechanisms  designed  to 
function  in  a  language-free  deep  conceptual  base 
(Conceptual  Dependency’.  The  conceptual  analysis  of  a 
natural  language  sentence  into  thi*»  conceptual  base,  and 
the  nature  of  the  memory  which  stores  and  operates  upon 
these  conceptual  structures  are  described  from  both 
theoretical  and  practical  standpoints.  The  various  types 
of  inferences  which  can  be  made  during  and  after  the 
conceptual  analysis  of  a  sentence  are  defined,  and  a 
functioning  program  which  performs  these  inference  tasks 
is  described.  Actual  computer  output  is  included. 


This  research  was  supported  by  the  Advanced  Research  Projects  Agency 
of  the  Department  of  Defense  under  Contract  SD-183. 

The  views  and  conclusir.is  contained  in  this  document  are  those  of  the 
authors  and  should  not  bt  interpreted  as  necessarily  representing  the 
official  policies,  either  expressed  or  implied,  of  the  Advanced 
Research  Projects  Agency  or  the  U.S.  Government. 

Reproduced  in  the  USA,  Available  from  the  National  Technical 
Information  Service.  Spr inc f ield,  Virginia  22151. 


INFERENCE  AND  THE  COMPUTER  UNDERSTANDING 
OF  NATURAL  LANGUAGE 

by 

Roger  C.  Schank 
Charles  J.  Rieger  111 


CONTENTS 


1.  INTRODUCTION  . 

I*.  INFERENCE  ANO  PARSING  . 

III.  THE  FOURTEEN  PRIMITIVE  ACTIONS  . 

IV.  LANGUAGE -FREE  INFERENCES  . 

V.  OBSERVATIONS  . 

VI.  THE  PROGRAM  . 

APPENDIX  A:  COMPUTER  EXAMPLES  . 

APPENDIX  Bs  INFERENCE  AND  REFERENCE  ESTABLISHMENT  .  .  . 

REFERENCES  . 


The  question  of  what  belongs  to  the  domain  of  parsing  and  what  is 
part  of  the  domain  of  inference  inevitably  comes  up  when  attempting  to 
put  together  a  system  in  order  to  do  natural  language  understanding. 
This  paper  is  intended  to  explain  the  difference  within  the  context  of 
Conceptual  Dependency  Theory  (51,  C63 , and  (73,  categorize  the  kinds  of 
inferences  that  are  necessary  within  such  an  understanding  system,  and 
outline  the  basic  elements  and  processes  that  make  up  the  program  at 
Stanford  that  currently  fandles  these  inference  tasks. 

He  shall  assume  in  this  paper  that  it  is  the  desire  of  those 
researchers  who  work  on  the  problems  of  computational  linguistics  to 
have  a  system  that  is  capable  of  responding  intelligently,  on  the  basis 
of  its  own  model  of  the  world,  in  reaction  to  3  given  input  sentence. 
Thus,  we  assume  here  that  a  system  that  responds  as  follows  (for 
example)  is  both  an  interesting  and  useful  system  if  it  accomplishes 
these  things  in  a  ‘theoretically  correct’  manners 

(1)  INPUT:  1  am  going  to  buy  some  aspirin  for  my  cold. 

OU'iPUT:  Uhy  don’t,  you  try  some  chicken  soup  instead? 

(2)  INPUT:  John  asked  flary  for  a  book. 

OUTPUT:  A  book  about  what? 

(3)  INPUT:  Do  you  want  a  piece  of  chocolate. 

OUTPUT:  No,  I  don't  want  to  spoil  my  appetite  for  dinner. 

(A)  INPUT:  John  went  to  the  store. 

OUTPUT:  Uhat  did  he  want  to  buy? 
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Before  getting  into  the  descriptions  of  the  various  Kinds  of 
inferences  to  which  a  conceptual  memory  should  be  sensitive,  the  notion 
of  inference  and  how  it  differs  from  logical  deductions  (for  instance  in 
a  theorem-prover  or  question  ansuerer)  should  be  made  clear. 

In  i  1 3  broadest  sense,  we  consider  an  inference  to  be  a  new  piece 
of  information  which  is  generated  from  other  pieces  of  information,  and 
which  may  or  may  not  be  true.  The  intent  of  inference-making  is  to 
"fill  out"  a  situation  which  is  ai luded  to  by  an  utterance  (or  story 
line)  in  hopes  of  tying  pieces  of  information  together  *o  determine  such 
things  as  feasibility,  causality  and  intent  of  the  utterance  at  that 
point.  There  are  several  features  of  all  inferences  which  should  make 
clear  how  an  inference  differs  m  substance  and  intent  from  a  formal 
deduc  t i on: 

(1)  Inference  generation  is  a  "reflex  response"  in  a  conceptual 
memory.  That  is.  one  of  the  definitions  of  "processing 
conceptual  input"  is  the  generation  of  inferences  from  it.  This 
means  that  there  is  always  an  implicit  motivation  to  generate 
new  information  from  old.  In  a  theorem  prover  or  question- 
answerer,  deductions  are  performed  only  upon  demand  from  some 
external  process. 

(2)  An  inference  is  not  necessarily  a  iogically  val id  deduction. 

This  means  that  the  new  information  represented  by  the  inference 
might  not  bear  any  formal  logical  relationship  to  those  pieces 
of  information  from  which  it  is  generated.  A  good  example  of 
this  is  called  "affirmation  of  the  consequent",  a  technique 
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fruitfully  utilized  by  Sherlock  Holmes,  and  certainly  utilized 
by  people  in  everyday  situations.  Briefly,  this  refers  to  the 
"syllogism"  A  a  B,  B;  therefore  A.  in  this  sense  (and  there  are 
other  examples),  conceptual  memory  is  strikingly  different  from 
a  formal  deductive  system. 

(3)  An  obvious  •sequence  of  (2)  is  that  an  inference  is  not 
necessarily  true,  for  this  reason,  it  is  useful  for  memory  to 
retain  and  propagate  measures  of  the  degree  to  which  a  piece  of 
information  is  likely  to  be  true.  Memory  must  also  be  designed 


whith  the  idea 

that 

NO 

information  is 

i  nv  i 

o  1  ab  1  y 

true, 

but 

rather  must  al 

Iways 

oe 

ui 1 1 ing  and 

able 

to  respond 

to 

contradictions. 

(4)  The  motivations 

for 

inference  generation 

and 

forma! 

deduc  t i on 

are  entirely  different.  Fornai  deductions  are  highly  directed  in 
the  souse  that  a  well-defined  goal  has  been  established,  and  a 
path  from  3ome  starting  conditions  (axioms  and  theorems)  to  this 
goal  is  desired.  Inferences  on  the  other  hand  are  not  nearly  so 
directed.  Infc-  ances  are  generally  made  "to  see  what  they  can 
see".  The  "goal"  of  inferenciny  is  rather  amorphous:  make  ar. 
inference,  then  test  to  see  whether  it  looks  similar  to,  is 
identical  to,  er  contradicts  some  other  piece  of  information  in 
the  system.  When  one  of  these  situations  occurs,  memory  takes 
special  action  in  the  form  of  discontinuing  a  lire  of 
interencing,  asking  a  question,  revising  old  information, 
creating  causal  relationships,  or  invoking  a  belief  pattern. 
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(5!  A  memory  which  uses  the  types  of  inference  we  will  describe 
needs  some  means  of  recourse  for  altering  the  credibility  of  a 
piece  of  information  when  the  credibility  of  some  piece  of 
information  which  was  used  in  its  generation  changos.  In  other 
words,  memory  needs  tc  remember  WHY  a  piece  of  informat  ion 
exists.  In  contrast,  a  forma!  deductive  system  in  general 
doesn’t  "care"  (or  need  to  knou)  uhere  a  fact  came  from,  only 
that  it  exists  and  is  true. 

Having  made  these  distinctions  between  conceptual  inference  and 
other  types  of  logical  deductions,  ue  will  describe  some  distinct  xypes 
of  inference. 


Ue  take  as  one  of  our  operating  assumptions,  that  the  desired 
output  for  a  conceptual  analyzer  is  a  meaning  representation.  Since  *4 
is  possible  to  go  directly  from  an  input  .cntence  into  a  meaning 
representation  (see  (43  ,  (53  and  (93  for  descriptions  of  computer 
programs  that  do  this),  ue  shall  disregard  any  discussion  of  syntactic 
parsing  output. 

Uhat  then  should  bs  present  in  a  meaning  representation?  Ue  claim 
that  it  is  necessary  for  a  meaning  representation  to  contain  each  and 
every  concept  and  conceptual  relation  that  is  explicitly  or  imolicitly 
referred  to  by  the  sentence  being  considered, 
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By  explicit  reference  ue  mean  the  concepts  that  underlie  a  given 
nord.  Thus  ue  have  the  concept  of  John  for  ‘John’  and  the  concept  of  a 
book  for  ‘book’  in  sentence  (51: 

(5)  John  bought  a  book. 

Minever,  ue  claim  in  addition  that  an  adequate  i.  caning  representation 
must  make  explicit  uhat  is  implicit  but  nonetheless  definitely 
referenced  in  a  given  sentence.  Thus,  in  (S)  we  nave  the  word  ‘bough’i’ 
which  implicitly  references  two  actions  of  transfer,  one  whose  object  is 
the  book  and  the  other  whose  iect  is  some  valuable  entity.  Host 
hearers  of  (5),  unless  specifically  told  otherwise,  will  assume  that 
this  object  is  ‘money’. 

It  is  here  then  that  we  shali  make  our  first  distinction  between 
the  province  of  parsing  (or  the  extraction  of  explicit  and  implicit 
information)  and  that  of  inference  (the  adding-or,  of  probably  correct 
information).  The  word  ‘buy’  has  a  nuoiber  of  senses  in  English,  but  the 
surrounding  information  disambiguates  ‘buy’  so  that  in  tb)  it  can  only 
mean  that  two  actions  cf  transfer  occurred  and  that  each  action  caused 
the  other’s  existence.  Furthermore,  it  is  always  true  that  whenever  one 
of  these  transfer  actions  is  present  (hence  called  A7RAN3  for  abstract 
transfer)  it  is  also  true  that  an  actor  did  the  ATRANSing;  there  was  an 
object  acted  upon,  and  there  was  a  recipient  and  a  donor  of  this  object, 
Ue  now  state  our  first  inference  type  which  we  call  LINGUISTIC 
INFERENCE 
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1.  An  instance  of  LINGUISTIC- INFERENCE  exists  when,  in  the 
abse  ice  of  specific  information  to  the  contrary,  a  given 
iiord  or  syntactic  construction  can  be  taken  to  mean  that  a 
specific  hut  unmentioned  object  is  present  in  a  predicted 
case  for  a  given  ACT  with  a  tiklihood  of  near  certainty. 

In  the  above  example,  the  ACT  is  ATRANS,  its  predicted  cases  are 
OBJECT.  RECIPIENT  (includes  receiver  and  donor)  and  INSTRUMENT.  The 
word  'buy'  by  definition  refers  to  the  ACT  ATPANS  and  therefore 
impl  icitly  references  its  cases.  However,  in  addition  ‘buy’  hsu  as  a 
linguistic  inference  the  object  ‘money’  as  the  object  of  the  ATRANS 
whose  actor  is  the  subject  of  the  sentence  in  which  ‘bug’  appears. 

Ue  assign  to  the  conceptual  analyzer  the  problem  of  handling 
explicit  reference,  implicit  reference,  and  linguistic  inference  within 
a  meaning  representation  because  these  are  consequences  of  words.  Using 
Conceptual  Dependency  notation  (where  <»>  denotes  the  relation  between 
actor  and  action;  0  denotes  the  relation  between  action  and  object; 
<a  denotes  causality  dependence;  and 

R  I  — 

< - 1 

I- 

dencw-s  the  relation  between  action,  object,  recipient  and  donor),  the 
conceptual  analyzer  (described  in  IAJ )  outputs  the  following  for  (5); 
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p  0 

JOHN  <*=*===*>  fcA.TRANS#  - - HONEY 

/  \  I  |  I  ? 

mu,  I  R  I  *ONE* 


I!  11! 
II  \  '' 


JOHN 


#ONE*  <»=■*•**=>  *ATRANS*  - - BOOK 

|  R  »  JOHN 

I— 1 1 

|< —  *CiNE# 

Tuo  more  common  examples  of  linguistic  inference  can  be  seen  with 
reference  to  sentences  (6)  and  (7): 

(S)  Does  John  drink? 

(7)  John  hit  Nary. 


In  (6)  most  hearers  assume  that  the  referenced  object  is  ‘alcoholic 
beverages*  although  it  is  unstated.  It  is  a  property  of  the  word  ‘drink* 
that  when  it  appears  without  a  sentential  object  ‘alcoholic  beverage’  is 
understood.  (In  fact,  this  a  property  uf  quite  a  few  languages,  but 
from  this  it  should  not  bethought  that  this  is  a  proparty  of  the 
concept  underlying  ‘drink'.  Father  i  t  is  an  artifact  of  the  languages 
that  most  of  them  share  common  cultural  associations.)  Thus,  given  tha< 
this  is  a  linguistic  inference,  and  that  our  conceptual  analyzer  is 
responsible  for  making  linguistic  inferences  our  analyzer  puts  cut  the 
following  conceptual  structure  for  it: 
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?  0 
JOHN  <  =  ==>  *1NGEST*  *—  LIQUOR 
t 

j  D  |— *  *  INS  IDE*  — -  JOHN 

i__j 

|*—  *f10U7H*  — -  JOHN 

The  ACT  INGEST  is  used  nere.  Ue  shall  explain  the  notion  ot  a  primitive 
ACT  in  the  next  section. 

In  (7),  we  again  have  the  problem  that  wnat  hearers  usually  assume 
to  be  the  meaning  of  this  sentence  is  in  fact  cite  beyond  what  the 
sentence  explicitly  says.  Sentence  (7)  does  not  explicitly  state  what 
John  did.  Rather  we  must  call  upon  some  other  information  to  decide  :f 
John  threw  something  at  Mary  or  if  he  swung  his  hand  at  her  (and  whether 
nis  hand  was  holding  some  object*.  Notice  that  the  same  ambiguity 
exists  if  we  had  sentence  (8),  but  that  one  meaning  is  preferred  over 
tne  other  in  O) : 

i8 )  John  hit  Mary  with  a  stick. 

(9)  John  hit  flary  with  a  slingshot. 

Ue  shall  c'aim  that  for  (7)  whew  no  other  information  is  explicit,  the 
most  1 ikely  reading  is  identical  with  the  reading  for  (10): 

(10)  John  hit  Nary  with  his  hand. 

Thus,  (7)  is  another  ex'"  pie  of  linguistic  inference  and  it  is  the 
responsibility  of  the  concep*  al  analyzer  to  as^’-me  ‘hand’  as  tne  thing 
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that  hit  Mary  on  Basis  of  having  seen  'hit'  occurring  with  no 

syntactic  instrument.  (Note  tnat  syntactic  instrument  is  quite 
different  from  the  conceptual  INSTRUMENTAL  '.ase  mentioned  earlier). 
Before  -ie  get  into  inferences  that  are  not  linguistic  it  u  i  II  be 
necessary  to  explain  further  the  elements  of  the  meaning  representation 
that  we  use  as  the  input  to  our  inference  making  procedures. 

Ue  uould  like  to  point  out  at  this  point  that  we  assign  the 
problem  of  extracting  conceptual  structures  and  making  linguistic 
inferences  to  the  domain  of  the  conceptual  analyzer.  This  is  because  the 
information  that  is  used  for  making  the  decisions  involved  in  those 
processes  is  contained  in  the  particular  language  under  analysis.  From 
this  point  on  in  this  paper  ue  shall  be  discussing  inferences  thai  come 
from  world  knowledge  rather  than  from  a  particular  language,  it  is  those 
interlingual  processes  the t  we  assign  to  the  domain  of  a  memory  and 
inference  program  such  as  ue  shall  describe  in  section  VI. 

III.  THE  FOURTEEN  PRIMITIVE  ACTIONS 

Conceptual  Deoedency  theory  is  intended  to  be  an  interlingual 
meaning  representation  Because  it  is  intended  to  be  language  free,  it 
is  necessary  in  our  representations  to  break  down  sentences  into  the 
elements  that  rake  them  up,  In  oraer  to  do  this  it  is  necessary  to 
establish  a  syntax  of  possible  conceptual  relationships  and  a  set  of 
conceptual  categories  that  these  relate.  Furthermore  it  is  necessary 
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that  requirements  be  established  for  hou  a  given  uord  is  mapped  into  s 
conceptual  construction. 

There  arr  six  conceptual  categories  in  Conceptual  Dependency: 


PP  Real  world  objects 

ACT  Real  world  actions 

PA  Attributes  of  objects 

AA  Attributes  of  actions 

T  Times 

LOC  Locations 


These  categories  can  relate  in  certain  specified  ways  which  are 
considered  to  be  the  syntactic  rules  of  conceptualizations.  There  ar 
sixteen  of  these  conceptual  syntax  rules,  but  we  shall  list  here  only 
the  onss  that  will  be  used  in  this  paper: 


PP  <*>  ACT  indicates  that  an  actor  acted 

PF  <b>  PA  indicates  that  an  object  is  rn  a  given  state 

0 

ACT  « -  PP  indicates  the  object  of  an  action 

R  (—  PP 

ACT  * — |  indicates  the  recipient  and  the  donor  of  an 

|<—  PP  object  within  an  action 

0  |  —  PP 

ACT  « —  j  indicates  tfc  direction  of  an  object  within 

PP  an  action 

I  A 
ACT  v—  |  j 
\/ 

X 

/  \ 


Y 

|—  PA2 

PP  <*|  indicates  a  state  change  of  an  object 

PA1 

PP1  « —  PP2  indicates  that  PP2  is  either  PART  Or  or  the 
POSSESSOR  OF  PP1 


In  Conceptual  Dependency,  tenses  are  considered  to  be 
modifications  of  the  main  link  between  actor  and  action  (<»>),  or  the 
link  between  an  object  and  its  state  (<s>).  The  main  link  modifiers  we 
sha I  I  use  here  are: 


indicates  the  instrumental  conceptualization 
for  an  action 


indicates  that  conceptualization  X  caused 
conceptualization  Y.  When  wr.tten  with  a  "c“, 
this  form  denotes  that  X  COULD  cause  Y. 
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past 
future 
present 

begin  a  relation  at  time  x 
end  a  relation  at  time  x 
condi t i onal 
negat i on 
quest  ion 

The  most  important  category  for  our  purposes  here  is  the  ACT.  A 

uord  maps  into  an  ACT  uhen  it  specifically  refers  to  a  given  possible 

action  in  the  world.  Often  verbs  only  reference  unstated  actions  and 
make  specific  reference  to  states  or  relationships  betueen  these 

unspecified  actions.  As  an  example  of  the  former  we  have  sentence  (11): 

(11)  John  hurt  flaru. 

Here,  the  real  world  action  that  John  did  is  unstated.  Only  the 
effect  of  this  action  is  known:  namely  that  it  caused  Mary  to  enter  a 
‘hurt’  state.  Similarly,  in  (12)  the  word  ‘prevent’  is  not  a  specific 
real  world  action  but  rather  refers  to  the  fact  that  some  unstated 
action  caused  that  some  other  action  (that  may  or  may  not  be  specified 
later  on  in  the  sentence)  did  not  occur. 

(12)  John  orevented  flaru  from  giving  a  book  to  Bill. 

The  analyses  of  these  sentences  (11  and  1?)  are  as  follows: 


P 

f 

(nul  I ) 
ts  =  x 
t  f  =x 
c 
/ 

? 


12 


p 

JOHN  <*•=>  *00* 
/  N 


and 


p  | — ►  *HEALTH*  «  (X-Z) 

NAR  V  <sffsazwff| 

I*-—  *HEALTH*  -  (X) 


P 

JOHN  <=**>  *00* 
/  \ 


111 

c/  0 

NARY  <•,*.«.=.=>  *ATfiANS*  — BOOK 
P  * 

|  R  !-- .  BILL 

I _ I 

!<• —  NARY 


Since  many  verbs  are  decomposed  into  constructions  that  involve 
only  unstated  actions  (denoted  by  DO)  and/or  attributes  of  objects 
(PA’s)  and  since  ue  require  that  any  tuo  sentences  that  have  the  same 
meaning  be  represented  in  one  and  only  one  way,  the  set  of  primitive 
ACTs  that  are  used  >s  important. 

Ue  have  found  that  a  set  of  only  fourteen  primitive  actions  is 
necessary  to  account  for  the  action  part  of  a  large  class  of  natural 
language  sentences.  This  rices  not  mean  that  these  primitives  are  merely 
category  names  for  types  of  actions.  Rather,  any  given  verb  is  mapped 
into  a  conceptual  construction  that  may  use  one  or  more  of  the  primitive 
ACTs  in  certain  specified  relationships  plus  other  object  and  state 
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information.  That  is.  it  is  very  important  that  no  information  be  lost 
Mjth  the  use  of  these  primitives.  it  is  the  task  of  the  primitives  to 
conjoin  similar  information  so  that  inference  rules  need  not  be  written 


for  every  individual  surface  verb,  but  rather  inference  rules  can  be 
written  for  the  ACTs.  This  of  course  turns  out  to  be  extremely 
economical  from  the  point  of  view  of  memory  functioning. 

Tne  fourteen  AC  is  are: 


ATRANS  The  transfer  of  an  abstract  relationship  such  as 
possession,  ownership,  or  control. 

P TRANS  The  transfer  of  physical  location  of  an  object. 

PROPEL  The  application  of  a  physical  force  to  an  object, 

MOVE  The  movement  of  a  bodypart  of  an  animal. 

GRASP  The  grasping  of  an  object  by  an  actor. 

INGEST  The  taking  in  of  an  object  by  an  animal. 

EXPEL  The  expulsion  from  the  body  of  an  animal  into 
the  wor Id. 


NTRANS 


The  transfer  of  mental  information  between 
animals  or  within  an  animal.  Ue  partition  menury 
into  CP  (conscious  processor),  LTN  (long-term 
memory),  and  sense  organs.  NTRANSing  takes  p.ace 
between  these  ments^  i^cst'ions. 


COIC  The  conceptual iz inn  thinking  about  an  idea  by 
an  an i ma I . 

NBUILO  The  construction  by  an  animal  of  new  information 
from  old  information. 


SNELL  The  action  of  directing  ones  nose  towrds  an  odor 

SPEAK  The  action  cf  producing  sounds  from  the  mouth, 

LOOK-AT  The  directing  of  ones  eues  towards  an  object. 


LISTEN-TO  The  directing  of  ones  ears  towards  an  object. 


1-4 


The  following  important  rules 


are  used  within  Conceptual 


Dependency: 

(1)  There  are  four  conceptual  cases:  OBJECTIVE.  B£CI£I£MI.  Q1BECILYE. 


\2)  Each  ACT  takes  from  two  to  three  of  these  cases  obi  igatcral  ly  and 
none  optional ly. 

(3)  INSTRUMENTAL  case  is  itself  a  complete  conceptualization  involving 

an  ACT  and  i ts  cases. 

(4)  Only  animate  objects  may  serve  as  actors  except  for  PROPEL. 

We  are  now  ready  to  return  to  the  problem  of  inference. 


The  next  class  of  inference  we  shall  discuss  are  those  that  come 
from  objects  and  relate  to  the  norma!  function  of  those  objects.  As 
examples  we  have  sentences  (13)  and  (14): 

(135  John  told  Mlaru  that  he  wants  a  book. 

(14)  John  likes  chocolate. 


These  sentences  have  in  common  th3t  they  refer  to  an  action  without 
specifically  stating  it.  In  these  examples,  this  missing  act  concerns 
the  probable  use  of  some  object.  In  (13)  that  ACT  is  probably  NTRANS 
(i.e.  people  usually  want  books  because  they  want  to  NTRANS  information 
from  them)  and  in  (14)  that  ACT  is  probably  INGEST  (i.e.  people  normal  I y 
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‘like’  chocolate  because  they  like  to  INGEST  it).  While  it  is  certainly 
possible  that  these  were  not  the  intended  ACTs  (John  could  like  burning 
books  and  painting  with  chocolate)  it  is  highly  likely  that  uithout 
contrary  information  most  speakers  uii!  assume  that  thses  ACTs  uere 
referenced.  In  fact,  psychological  t’sts  have  shown  that  in  many  cases 
most  hearers  uill  not  actually  remember  whether  the  ACTs  uere 
specifically  mentioned  or  not.  Notice  in  the  first  example  that  the 
missing  fITRANS  (of  information  from  the  book)  is  an  inference  uhich 
occurs  AFTER  the  meaning  representation  of  the  sentence  has  been 
established  (i.e.  this  sentence  is  analyzed  as  ‘if  someone  were  to 
ATRANS  a  book  to  me  it  uould  cause  me  pleasure’),  On  the  other  hand,  the 
missing  INGEST  in  the  second  example  is  inferred  during  the  analysis 
because  the  REPRESENTATION  itself  depends  upon  the  analyzer  knowing  what 
it  means  to  ‘like’  a  food.  Therefore,  the  determination  of  an  object’s 
probable  relation  to  an  actor  is  never  strictly  a  part  of  just  the 
analyzer  or  just  the  memo'-y,  but  rather  a  tasx  of  conceptual  analysis  in 
general . 

It  is  important  to  mention  that,  regardless  of  the  ul t i mate 
correctness  of  the  chosen  ACT,  Conceptual  Dependency  predicts  that  an 
ACT  is  missing  because  verbs  like  ‘uant’  and  ‘like’  are  represented  as 
states.  In  the  parsing  of  each  of  these  sentences  it  is  found  that  an 
actor  and  an  object  are  present  with  no  ACT  to  link  them.  This  causes  a 
search  to  be  made  for  the  correct  ACT  to  fill  that  spot. 

We  thus  have  our  second  and  third  inference-types: 

2.  An  instance  of  ACT- INFERENCE  is  present  uhen  an  actor 


IE 


and  ar,  object  occur  in  a  conceptual izat ion  without  an  ACT  to 
connect  them,  and  the  object  in  question  has  a  normal 
function  in  the  world.  In  this  case  the  normal  function  is 
assumed  to  be  the  implicitly  referenced  ACT. 
and 


3.  A  TRAN3-ENA3LE- INFERENCE  occurs  with  a  conceptualizations 
involving  one  of  the  TRANS  ACTs.  It  is  inferred  that  the 
TRANS  conceptualization  enables  another  conceptualization 
involving  the  same  actor  and  object  to  take  place.  Ths 
specific  act  for  this  inferred  conceptualization  then  comes 
about  via  ACT-INFERENCE.  Inferences  of  this  type  are 
frequently  useful  for  inferring  the  intended  use  of  a 
physical  or  mental  object. 


The  finished  analyses  for  (13)  and  (14)  after  ACT-INFERENCE  and 
TRANS-ENABLE- INFERENCE  take  place  are  then: 


p  D  [  — *  *CP*  ' —  MARY 

JOHN  <■■«>  *HTRANS*  *■ — | 

t  |— -  *CP*  JOHN 
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f  0 
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III  |-~ ♦  *JQY*  =  \X+2) 
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(i.e.  the  conceptual izat ion 
to  the  left  has  mental 
location  John’s  LTM) 
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(which  eventually  leads  to  a  similar  graph,  except  that 


f  0 

JOHN  <««■>  *MTRANS*  CONCEPTS* 
t 

|  o  I— .  *CP*  «—  JOHN 
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K—  BOOK 


replaces  the  *ATRANS#,  i.e.  John  wants  to  read  the  book), 
and 
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The  next  kind  of  inference  that  we  shall  discuss  has  to  do  with 
the  results  of  a  given  ACT.  Consider  sentences  (15),  (IS),  and  (17): 

(15)  John  went  to  South  Dakota. 

(1G)  John  tolo  fia-y  that  Bill  was  a  doctor. 

(17)  John  gave  flary  a  hoos. 


Each  of  these  sentences  refers  to  an  ACT  that  ha9  a  common  result.  Here 
again,  when  no  information  is  given  that  contradicts  this  prediction,  it 
is  reasonable  to  assume  that  the  normal  result  of  the  action  was 
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achieved.  (Here,  as  in  most  of  the  examples  given  in  this  paper,  it  is 
necessary  in  English  to  use  the  conjunction  ‘but’  to  indicate  that  the 
inferred  result  did  not  take  place.  Thus,  unless  ue  add  ‘but  he  didn’t 
get  there’  to  (15),  the  hearer  will  assume  he  did.) 

Ue  thus  have  our  fourth  example  of  inference: 

4.  RESULT - 1 NFERENCE  can  be  made  whenever  a  TRANS  ACT  is 
present  and  no  information  exists  that  would  contradict  the 
inferred  resu! t. 

Thus,  whenever  PTRANS  is  present,  ue  can  infer  that  the  location 
of  the  object  is  now  the  directive  case  of  PTRANS.  Whenever  ATRANS  is 
present  we  can  infer  that  there  is  a  rsu  possessor  of  the  object,  namely 
The  recipient,  and  lastly,  wherever  an  HTRAN3  occurs  we  can  assume  that 
the  information  that  was  transferred  to  the  conscious  processor  (CP)  of 
the  brain  became  present  there.  Thus  for  (16),  Nary  can  be  assumed  to 
‘know’  the  information  trat  was  told  to  her  since  ‘know’  is  represented 
as  'exist  in  the  iong  term  memory  (LTfl)  ’  and  ‘tell’  involves  IITRANSing 
to  ths  conscious  processor  which  leads  to  LTfl.  A  program  that  deals 
with  this  problem  will  be  discussed  later  on  in  this  paper. 

The  fifth  kind  of  inference  that  we  shall  discuss  is  called 
OBJECT-AFFECT- I NFERENCE.  This  kind  of  inference  also  concerns  the 
result  of  an  ACT  but  here  ue  mean  result  to  refer  to  some  new  physical 
state  of  the  object  involved.  Sentences  (13)  and  (19)  illustrate  this 
prob I em: 


(18)  John  hit  Nary  uitb  a  rock. 
0.9)  John  ate  the  egg. 
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Both  (IS)  and  fiS)  make  an  implicit  statement  about  a  new  physical  state 
of  the  item  that  is  in  the  objective  case,  in  (18)  we  can  guess  that 
Mary's  state  of  physical  health  might  nave  been  diminished  by  this  ACT 
(i.e.  she  was  hurt).  In  (19/  we  know  that  the  egg,  no  matter  what  state 
it  wa9  in  before  this  ACT,  is  now  in  a  state  of  not  existing  at  all 
anymore.  Thus  ue  have  inference- type  5: 


5.  An  instance  of  OBJECT-AFFECT- I NFERENCE  may  be  present 
with  any  of  the  physical  ACTs  (INGEST,  EXPEL,  PROPEL,  GRASP, 
MOVE).  The  certainty  of  any  of  these  inferences  is  dependent 
on  the  particular  ACT,  i.e.,  INGEST  almost  always  affects 
the  object,  PROPEL  usually  does,  and  the  effects  of  the 
others  are  less  frequent  but  possible.  Uhen  OBJECT-AFFECT- 
INFERENCE  is  present,  a  new  resultant  physical  etate  is 
understood  as  having  been  caused  by  the  given  ACT. 


The  analyses  for  (18)  and  (13)  are  given  below.  Note  that  if 
‘rock’  is  replaced  by  ‘feather*  in  (18)  the  inference  under  discussion 
ia  invalid.  Thus,  in  order  to  accomplish  this  inference  correctly  on  a 
machine,  the  specifications  for  under  what  conditions  it  is  valid  for  a 
given  ACT  must  be  given.  Obviously  these  specifications  involve  mass  and 
acceleration  as  well  as  fragility  in  the  case  of  PROPEL. 
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3nd 


P  0 
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!«■—  *HOUTH*  «—  JOHN 

The  next  Kind  of  inference  we  shall  discuss  concerns  the  reasons 
for  a  given  action.  Until  now,  we  have  only  considered  the  effects  of  an 
action  or  the  unstated  pieces  of  a  given  conceptual izt ion.  However,  in 
order  to  conduc'  an  Intel  ’  i gent  conversation  it  '13  often  necessary  to 
'sr  the  reason  behind  a  given  event.  Consider  sentences  (20), (21),  and 


(20)  John  hit  flary. 

(21!  John  took  an  aspirin. 

(22)  John  flattered  flary. 

We  would  like  a  computer  to  have  the  ability  to  respond  to  these 
sentences  as  fol lows; 

(20a)  What  did  Nary  do  to  make  John  angry? 

(21a)  What  was  wrong  with  John? 

(22a)  What  does  John  want  Nary  to  do  for  him? 

In  order  to  accomplish  this,  we  need  to  use  some  of  the  inference-types 
discussed  above  first.  Thus,  in  (20),  we  must  first  establish  that  Nary 
might  be  hurt  before  we  can  invoke  an  appropriate  belief  pattern.  By 
belief  pattern  we  mean  a  sequence  of  causally-related  ACTs  and  states 
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that  are  shared  by  many  speakers  within  a  culture.  Such  a  sequence 
usually  deals  with  what  is  appropriate  or  expected  behavior  and  is  often 
a  prescription  for  action  on  the  pa~t  of  the  hearer. 

The  belief  pattern  called  by  (20)  is  commonly  described  as 
VENGEANCE.  It  states  that  people  do  things  to  hurt  people  because  they 
feel  that  have  been  hurt  by  that  person.  7h'i3  belief  pattern  supplies  a 
reason  for  the  action  by  the  actor.  Thus  we  come  to  the  sixth  kind  of 
inference: 

G.  An  instance  of  BELIEF-PATTERN- INFERENCE  exists  if  the 
given  event  plus  i*s  inferred  results  fits  a  belief  pattern 
that  has  in  it  the  reason  for  that  kind  of  action  under 
ordinary  circumstances. 

In  example  (211  we  have  an  instance  of  the  UANT  belief  pattern 
which  refers  to  the  fact  that  people  seek  to  obtain  objects  for  what 
they  can  use  them  for  (this  is  intimately  related  to  inference-type  2 
discussed  above).  Sentence  (22)  refers  to  the  RECIPROCITY  belief 
pattern  (which  deals  with  'gocd'  th:ngs,  VENGEANCE  taking  care  of  the 
'bad'  ones).  RECIPROCITY  comes  in  two  types.  The  one  being  used  here  is 
anticipatory.  That  is,  the  action  is  being  done  with  the  hope  that  the 
nice  results  achieved  for  one  person  will  encourage  that  person  to  do 
something  which  will  yield  nice  results  for  the  original  actor. 

Ue  uil!  further  discuss  (20)  later  on  in  this  paper  when  ue 
outline  the  procedure  by  which  our  computer  program  produces  (20a)  in 
response  to  it. 

The  next  kind  of  inference  we  shall  discuss  is  called 


INSTRUMENTAL -INFERENCE.  It  is  the  nature  of  the  primitive  ACTs 
discussed  earlier  that  they  can  take  only  a  small  set  of  ACTs  as 
instrument.  Thus,  for  example,  whenever  INGEST  occurs  PTRANS  must  be 
its  instrumental  ACT  because  oy  definition  PTRANS  is  the  only  possible 
instrument  for  INGEST.  The  reason  for  this  is  that  in  order  for  someone 
to  eat  something  it  is  necessary  to  move  it  to  him  or  hiir,  to  it.  Thus, 
whenever  INGEST  is  present  we  can  make  the  legitimite  inference  that  the 
object  of  INGEST  was  PTRANSed  to  the  mouth  (nose,  ei  .)  of  the  actor.  If 
this  inference  is  incorrect,  it  is  only  because  the  direction  of  motion 
was  mouth  to  object  instead.  Also,  whenever  PTRANS  appears,  the 
instrument  must  have  been  either  HOVE  or  PROPEL.  That  is,  in  order  to 
change  the  location  of  snmething  it  s  necessary  to  move  a  bodypart  or 
else  apply  a  force  to  that  object  (which  in  turn  requires  moving  a 
bodypart).  Thus  we  have  the  sever, th  inference  type: 

7.  INSTRUMENTAL- INFERENCE  can  always  be  made,  although  the 
degree  of  accuracy  differs  depending  on  the  particular  ACT. 
Whenever  an  ACT  has  been  referenced,  its  prqbable  instrument 
can  be  inferred. 

The  list  of  instrumental  ACTs  for  the  primitive  ACTs  fo.lows: 
iNGEST:  instrument  i s  PTRANS 

PROPEL:  instrument  is  HOVE  or  GRASP  (ending)  or  PROPEL 

PTRANS:  instrument  is  HOVE  or  PROPEL 

ATRAN3:  instrument  is  PTRANS  or  HTRANS  or  HOVE 

CONC:  instrument  is  HTRANS 

HTRANS:  instrument  is  H5UIL0  or  SPEAK  or  SHELL  or 
L1STEN-T0  or  LOCK-AT  or  HOVE  or  nothing 
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hBUILQ:  instrument  is  HTRANS 

EXPEL:  instrument  is  HOVE  or  PROPEL 

GRASP:  instrument  is  HOVE 

SPEAK:  instrument  is  HOVE 

LOOK-AT: 

L1STEN-T0:  these  three  have  no  instruments 

SHELL: 

Using  this  table  it  is  possible,  for  example,  to  make  thb 
following  inferences  from  these  sentences: 

(23)  John  is  aware  that  f-  -ed  hit  Hary. 

(24)  John  received  the  ball. 


Since  (23*  refers  to  CONC  and  CONC  requires  UTRANS  as  instrument  we  can 
infer  (from  the  possible  instruments  of  UTRANS)  where  John  got  his 
information,  rie  could  have  HRUILOed  it  (not  likely  here  because  Fred 
hit  Hary  is  an  external  event);  he  could  -nve  percoived  it  from  his 
senses  by  LOOK-AT  it  himself;  or  by  LlSiEN-TO  someone  else  which 
MPANSpH  it  to  him.  Since  (24)  refers  to  °TRANS,  we  r.cve  two  possible 
instruments  HOVE  or  PROPEL.  Fr:n  this  we  can  infer  that  the  ball  was 
handed  to  him  (move  someone  e lie’s  bodypart)  or  else  it  w33  rolied  or 
thrown  (or  underwent  some  other  manner  of  apolying  a  force  to  a  ball). 

The  next  type  of  inference  is  PROPERTY- INFERENCE: 


S.  Uhenever  an  object  is  introduced  in  a  sentence  certain 
suboroposi tions  are  being  made.  The  most  common  instance  of 
this  is  the  predication  that  the  object  being  referenced 
exists.  The  inference  of  these  subpronost ions  we  call 
PROPERTY- INFERENCE. 


In  some  instances,  PROPERTY- INFERENCE  is  dependent  on  other 
inference  tyoes.  Thus,  in  the  sentence  ‘John  hit  Mary’,  rot  only  is  it 
necessary  to  make  the  PROPERTY- INFERENCE  that  both  John  and  flary  exist, 
but  it  is  also  necessary  to  realize  that  John  must  have  arms  in  order  to 
do  this.  This  inference  is  thus  dependent  cn  the  LINGUISTIC- INFERENCE 
that,  unless  otherwise  specified,  ‘hit1  refers  to  ‘hands’  as  the  object 
of  *e  PROPEL ing. 

PROPERTY- INFERENCE  is  necessary  in  a  computer  understanding  system 
in  order  to  enable  us  to  respond  either  with  9uprise  or  a  question  as  to 
manner  if  we  know  that  John  does  not  have  arms.  Furthermore,  in 
answering  questions,  it  often  happens  th3t  the  checking  of 
subpropositions  a-iociated  with  PROPERTY- INFERENCE  will  e’lcw  us  to  find 
an  answer  with  less  work.  Thus  for  sentence  (25): 

(25)  Did  Nixon  run  for  President  in  1863? 

Two  separate  subp'-opost ions  that  can  be  proved  false  allow  the  question 
to  he  answered  most  efficiently.  Establishing  that  ‘Nixon  was  alive  in 
1863*  is  false  or  ‘there  uas  a  presidential  election  in  18E3’  is  false 
is  probably  the  best  way  of  answering  the  question. 

Ue  have  not  discussed  to  this  point  the  standard  notions  of 
logical  inference  for  two  reasons:  (a)  the  problems  involving  logical 
inference  are  already  fairiy  uel  I  understood,  and  (b)  ws  do  not  view 
logical  inference  as  playing  a  CENTRAL  role  in  the  problem  of  computer 
understanding  of  natural  language.  However  there  exists  3  related 
problem  that  bears  discussion. 
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Consider  the  problem  of  two  sentences  that  occur  in  sequence. 
Often  such  sentences  have  additional  inferences  together  which  they 
would  not  have  separately.  For  example,  consider: 

(2Ga)  All  redheads  are  obnoxious, 
f 26b)  Queen  Elizabeth  i  had  red  hair. 

(27a)  John  wants  to  join  the  army. 

(27b)  John  is  a  pacifist. 


In  (26),  (26b)  has  its  obvious  surface  meaning,  but  also  can  mean  either 
one  of  two  additional  things.  Either  we  have  the  inference  that  Queen 
Elizabeth  I  was  obnoxious  according  to  the  speaker,  or  if  (26b)  were 
spoken  by  a  different  speaker  from  (26a),  there  exists  the  possibility 
that  (26b)  is  intended  as  a  refutation  of  (26a). 

For  (27),  a  sophisticated  language  analyzer  must  discover  that  (b) 
is  essentially  a  contradiction  of  (a)  and  hence  the  inference  that  the 
speaker  of  (b)  believes  that  the  speaker  of  (a)  is  in  error  is  probably 
correct.  Ue  thus  introduce  inference-  ype  9: 

9.  An  instance  of  SEQUENTIAL- INFERENCE  is  potentially 
present  when  one  sentence  follows  another  and  they  share  a 
subject  or  a  proposition.  Uhen  suboroposi t ions  or  inferences 
of  subpropositions  can  be  detected  as  common  to  both 
conceptualizations,  and  satisfy  certain  set  inclusion  or 
contradiction  rules.  SEQUENT! Al- INFERENCE  may  apply. 


The  next  k  rid  of  inference  is  quite  straightforward: 


10.  Ar  instance  of  CAUSAL  I  TV- INFERENCE  is  present  if  two 
sentences  are  connected  by  an  'and'  or  by  their  appearing  in 
sequence.  Then  if  one  could  have  caused  the  othei  .  it  can  be 
inferred  that  that  is  what  happened. 
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Consider  sentences  (28)  and  (29a  and  b): 


(28)  John  hit  Mary  and  she  died. 

(29a)  John  hit  Mary. 

(29b)  John  died. 

In  these  sentences  it  is  usually  cc-rect  to  assume  causality.  For  (28) 
we  infer  that  the  hitting  cajsed  Mary’s  death.  For  (23)  we  infer  that 
(a)  caused  (t).  It  is  our  knowledge  of  the  world  however  that  would 
cause  us  to  wonder  about  the  connection  in  (29)  but  not  in  (28).  A  good 
program  would  discover  this  to  be  a  different  kind  of  causality  from  the 
straight  result  present  in  (28).  Kinds  of  causality  are  discussed  in 
(7)  . 

Another  important  inference  type  BACKWARD- I NFERENCE .  This  type  of 
inference  can  be  made  whenever  an  action  has  occurred  that  required 
another  action  to  precede.  The  possible  actions  that  can  be  inferred  for 
a  given  ACT  as  BACKUARD  INFERENCE  are  oHen  quite  similar  to  those  which 
can  be  inferred  as  instruments  for  a  given  ACT.  We  use  this  kind  of 
inference  uhenever  an  object  is  acted  upon.  Thus  if  we  haver 

(30)  John  ate  a  banana. 

we  can  infer  that  the  banana  must  have  tx-en  PTRAmSp.U  to  him  at  some 
time.  Likewise,  whenever  a  mental  itpm  is  operated  upon  ita  previous 
MTRANSing  can  also  be  inferred.  If  we  have: 


(31)  John  knows  where  Mary  is. 


then  we  can  infer  that  this  information  must  have  been  MTRANSed  to  John 
at  some  poi  it  (either  from  his  eyes  or  from  someone  else  HTRANSing  this 
infromation  to  him).  Thus  we  have  inference  type  il: 

11.  All  conceptual i::ations  are  potentially  subject  to 
BACKUARO- 1 NFERENCE .  Depending  on  the  nature  of  the  object, 
one  of  the  TRANS  ACTs  can  be  inferred  as  having  enabled  the 
current  conceptualization’s  occurence. 

The  last  kind  of  inference  we  shall  discuss  concerns  the  intention 
of  the  actor.  Consider  the  following  sentences: 

(32)  John  hit  flary. 

(33)  John  told  Bill  that  he  wants  to  go  to  New  York. 

We  assume  that  a  person  does  something  because  he  wants  to  do  it  and 
that  he  wants  to  do  i  t  because  of  the  results  that  he  expects  to 
achieve.  Thus  a  valid  inference  here  is  that  it  is  the  intention  of  the 
actor  that  the  things  inferred  with  OBJECT-AFFECT- INFERENCE  or  RESULT- 
INFERENCE  ui I  I -occur,  and  that  these  *hings  are  desired  by  the  actor. 

Thus  from  (32)  using  inference-type  G  we  get  that  ‘flary  is  hurt 
pleases  John’.  From  (33).  using  inference-type  5,  we  get  that  ‘being 
located  in  New  York  will  please.  John’  and  ‘Bill  knouing  this  pleases 
John’.  Thus  ue  have  inference-type  12: 

12.  1 NTENT 1  ON- 1 NFEREf'CE  is  assumed  whenever  an  actor  acts 
unless  information  to  the  contrary  exists. 


V.  QB5ERY.AT_i.QN5 
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Using  the  inference  types  discussed  above  we  can  see  that  an 
effective  analysis  of  a  sentence  is  often  quite  a  bit  more  than  one 
might  superficially  imagine,  if  we  start  with  the  sentence  ‘John  hit 
Mary’  for  example,  our  conceptual  analyzer  would  perform  the  following 
conceptual  analysis: 

(3M 


P  0 

JOHN  <-->  tPROPEL*  - —  *PHYS0BJ* 
/  \  t 

i  | !  |  D  i— *  MARY 

III  l_J 

||j  I—-  JOHN 

III 

*PHYS0BJ* 


<*■*>  *PHYSC0NT* 


MARY 


During  and  after  the  language  analysis  the  consultation  of  the  above 
inference  processes  would  yield  the  following  results: 


LINGUISTIC  : 
OBJECT  AFFECT: 
BELIEF  PATTERN: 


INSTRUMENTAL: 


add  ‘hand’  as  object  of  PROPEL 

add  cajsal  ‘recipient  (Mary)  be  hurt’ 

add  potential  cause  of  the  entire  event  as 
Mary  DO  cause  John  be  hurt  cause  John 
be  angry 

add  instrument  of  MOVE  ‘hand’ 


PROPERTY:  add  predication  that  John  and  Mary  exist 

and  that  John  has  hands  and  that  they 
were  in  the  same  place  at  the  same  time 

INTENTION:  add  that  John  knew  that  it  would  cause  him 

pleasure  if  Mary  uas  hurt  and  that  is 
why  he  did  it 
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The  graph  after  analyzer- ini t i ated  inferences  have  filled  out  the 
meaning  representation,  Out  Oefore  MEMORY  gains  direct  processing 


control  is: 
(35) 


P  0  part 

JOHN  <»«>  *M0VE*  -  HAND  - - JOHN 


H 

p  40  part 

JOHN  <--»  *PR0PEL*  - —  HAND  - - JOHN 

/  \  t 

HI  |D  I— -  MARY 

III  l—l 

HI  |«—  JOHN 

par  t  III 

JOHN - -  HAND 

a  <s*«>  *PHYSC0NT* 

MARY 


VI.  THE  PROGRAM 

There  current  I y  ex i sts  at  the  Stanford  Artificial  Intelligence 
Laboratory  a  functioning  nrogram  which  works  in  conjunction  uith  the 
analysis  program  written  by  Riesbeck  14)  and  the  generation  program 
written  by  Goldman  E21.  This  program  is  capable  of  making  some  but  not 
all  of  the  inferences  described  here  and  of  generating  responses  which 
demonstrate  the  kind  of  understanding  to  which  we  have  been  referring  in 
this  paper. 

Ue  will  now  describe  the  theory  of  the  operation  of  this  program 
and  trace  in  detail  one  of  the  examples  we  have  discussed.  Please  bear 
in  mind  that  it  is  the  intent  of  both  the  program  and  this  paper  to  be 
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as  theoretically  correct  as  possible.  Therefore  on  occasion  we  have 
sacrificed  efficiency  for  theory.  It  was  not  the  intent  of  this  program 
to  do  a  dazzling  job  on  a  few  isolated  examples.  Rather  we  have  tried 
to  produce  a  program  that  is  easily  extendable  that  will  further  the 
cause  of  computer  understanding. 

After  conceptual  analysis  of  'John  hit  Mary’  is  complete,  MEMORY 
gains  processing  control  (MEMORY  has  already  played  a  passive  role 
during  analysis,  having  been  called  upon  for  knowledge  of  objects  and 
people,  and  asked  to  supply  the  missing  linguistic  and  object-affect 
i nfcrmat i on) . 

Before  examining  the  flew  of  an  example,  a  brief  explanation  of 
MEMORY’S  data  structures  and  goals  is  in  order.  All  propositional 
information  is  stored  in  list  positional  notation,  with  the  pr  Jicate 
first  and  the  conceptual  case  slots  following.  The  internally-stored 
form  of  a  proposition  is  called  a  bond,  and  is  stored  as  a  single  entity 
under  a  LISP  generated  atom  (superatom) .  In  this  way  propositions  are 
easily  embedded,  and,  except  for  their  bond.  100k  like  simple  concepts. 
Simple  concepts  have  only  an  occurence  set  to  define  them  {superatoms 
have  occurence  sets  too).  The  occur~nce  set  is  a  set  of  pointers  to 
superatoms  uhich  contain  instances  of  the  simple  concept,  MEMORY  is 
therefore  fully  tuo-way  linked.  The  totality  of  knowledge  about  a  simple 
concept  are  tnose  propositions  pointed  to  by  the  occurence  set. 

In  addition  To  bonds  and  occurence  sets,  superatoms  have  other 
characteristics.  Most  important  among  these  are  STRENGTH.  MODE,  TRUTH, 
REASONS  and  OFFSPRING.  STRENGTH  is  a  measure  of  how  much  credibility  a 
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preposition  has.  ana  usually  represents  a  composite  credibility  from 
those  proposition*  from  which  it  arose.  flOOE  modifies  •'he  proposition 
truth-wise  (negations  are  stored  as  flOf'E  ■  FALSE).  TRUTH  is  a  flag 
which  is  TDUE  if  this  proposition  is  true  in  the  world  at  the  present 
time.  (This  one  is  for  convenience,  since  this  information  could  be 
determined  from  the  time  modifications  or  nesting  of  the  proposition.) 
REASONS  is  the  set  of  suparatoms  which  participated  in  the  generation  of 
this  proposition  in  the  system  ( i e .  what  facts  were  used  to  infer  this 
proposition),  and  OFFSPRING  is  its  inverse  (ie.  what  rther  propositions 
has  this  one  played  a  part  in  inferring).  These  last  two  are  very 
important  because  they  give  MEMORY  recourse  to  retrace  its  paths  and 
modify  STRENGTHS,  or  discuss  its  reason'ng.  There  is  one  last  feature 
of  both  superatoms  and  simple  concepts:  RECENCY.  This  is  the  value  of 
the  system  clock  which  is  stored  each  time  the  superatom  or  concept  is 
accessed.  It  is  chiefly  used  for  reference  establishment. 

inferenclng  is  done  breadth-first  to  a  heur istical lij  controllable 
depth.  Inferences  have  the  same  data  structure  as  described  above,' 
namely,  each  new  inference  becomes  a  superatom,  complete  with  its 
occurence  set  and  the  other  properties  mentioned.  Inferences  are 
organized  as  lambda  functions  under  predicates,  and  are  ;nvoked  directly 
by  conceptualizations.  Pattern  matching  is  done  within  these  lambda 
functions  in  thr  form  of  program  te3ts  and  branches.  Times  are 
processed  along  with  each  proposition,  and  the  system  emphasizes  an 
awareness  of  time  relationships,  since  out-of-date  proposi t ions  are 
never  discarded,  but  rather  modified  by  new  time  relations.  A  forgetting 
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function  is  viewed  as  peripheral  to  the  types  of  tasks  we  are  currently 

performing.  Briefly,  these  tasks  are  the  following: 

(1)  to  establish  referents  of  all  concepts  appearing  in  a  conceptual 
graph.  This  requires  full  access  to  the  inference  mechanism,  and  is 
not  compartmentalized  as  a  well-defined  preprocessor. 

(2)  to  serve  as  a  passive  data  bank  and  access  mechanism  for  the 
analysis  and  generation  phases.  This  includes  answering  simple 
queries  during  the  analysis  such  as  "is  there  a  concept  which  is  a 
human  and  has  name  John"  as  wel1  as  performing  arbitrarily  involved 
proofs.  Typical  of  proof  requests  are  time  relation  proofs  required 
by  the  conceptual  generator. 

(3)  to  store  the  analyzed  contents  of  each  sentence.  This  involves  (1) 
as  a  subtask,  and  n  general  involves  the  storage  of  a  number  of 
subprepositions.  Old  information  is  detected  as  such,  so  that 
unless  hEIIORY  has  insufficient  information  to  identify  an  event  or 
state,  i  t * s  existence  in  IIEfiORY  is  discovered.  This  of  course 
applies  to  the  maintenance  of  simple  concepts  as  well:  HEI10RY  tries 
to  identify  all  concepts  and  tokers  of  concepts  with  existing  ones, 
and  notes  which  it  was  unable  to  identify. 

(A)  to  perform  appropriateness  checking  on  all  peripheral  implications 
of  an  input.  This  primarily  involves  such  tasks  as  making  sure  that 
actors  are  alivn  and  uell  and  in  the  right  places  for  their  actions, 
and  that  the  actions  are  reasonable. 

(S)  to  generate  unsolicited  inferences  of  the  types  described  earlier 
and  elevate  some  of  them  to  the  status  predictions  of  three  basic 
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classes  in  response  to  every  new  input.  (A  prediction  is  simply  an 
inference  the  system  has  chosen  to  focus  on  as  being  noteworthy  at 
some  point.)  These  three  classes  of  predictions  are  (a)  completatory 
predictions,  (b)  causal  predictions  and  (c)  result  predictions. 
Completatory  predictions  augment  conceptualizations  by  supplying  a 
most  likely  candidate  for  some  missing  information.  Causal 
predictions  try  to  relate  the  input  to  belief  patterns  which  could 
explain  the  reasons  behind  the  input.  Result  predictions  establish 
possible  outcomes  caused  by  the  input,  and  also  access  belief 
patterns. 

(G)  to  maintain  a  record  of  inferer.cing  ard  prediction  activity,  and  be 
able  to  ?nsuer  questions  about  and  discuss  reasons  for  inferred 
information.  This  capability  includes  the  ability  to  modify 
STRENGTHS  and  flOOEs  when  assumptions  which  lead  to  them  change  at 
some  future  time. 

(7)  to  answer  'who',  ‘whether’ ,  ’when’  and  ’why’  type  questions 
concerning  the  conceptualizations  it  has  been  given,  together  with 
their  inferences. 

He  now  return  to  the  example  "John  hit  Nary",  The 
conceptualization  has  form  (36) .  This  is  the  positional  form  of  the 
analyzed  version  (34)  9howr,  at  the  end  of  section  V.  Notice  that, 
although  the  words  "JOHN",  "HANO",  etc.  wore  used  in  that  diagram,  what 
the  analyzer  actually  parses  to  memory  are  descriptive  sets:  set3  of 
conceptual  propositions  which  NENPRY  can  use  to  identify  the  actual 
referents  of  the  concepts  described.  The  notation 


Cn:  C (PI)  ,  (Pkl I 


is  used  to  denote  some  concept  having  descriptive  propositions 
Pl,..,,Pk,  which  has  not  yet  been  identified  as  a  concept  uith  which 
MEMORY  is  familiar  (the  rsferent  has  not  bsen  determined) .  For  the 
examples,  tf<word>  will  stand  for  the  unique  concept  which  M<uord>" 
references  (and  will  be  unambiguous  in  those  examples). 

(36) 

((CAUSE  ((PROPEL  Cl: ((ISA  ^PERSON) (NAME  _  "JOHN”)) 

C2:  (USA  _  #HAND)  (PART  _  Cl)) 

Cl 

C3: ((ISA  _  ^PERSON) (NAME  _  "MARY")) 

)) 

(  "’HYSCONT  C2  C3) ) 

)  (TIME  C4:  I  (ISA  _  tfl  I  ME)  (BEFORE  _  0NCUH) 

) 


MEMORY’S  first  task  is  to  establish  the  referents  of  as  many  of 
the  simple  concepts  (Cl,...,Ck)  as  possible.  (3)  discusses  this 
procedure  and  its  problems  in  some  detail,  and  a  short  example  is 
included  as  APFENOIX  D.  Ue  will  assume  hers  that  all  referents  have 
been  correctly  identified.  After  this  phase,  the  conceptualization  has 
lorm  (37). 

(37) 

( (CAUSE  ( (PROPEL  0 JOHN  0C0001  #J0HN  #MARY) ) 

( (PKYSCONT  0C0001  0MARYI ) ) 

(TIME  _  #000021) 


where  C0001  is  the  concept  in  MEMORY  for  John’s  hand,  C0002  is  the 
concept  in  MEMORY  for  the  time  of  the  causal  event. 


35 


■  -|| f  j  j  | - 


raHhiTf  r  i 


Next,  fiEMOh Y  fragments  the  conceptualization  into  subpropositions, 
each  of  uhich  will  be  submitted  to  the  inferencer.  The  average  English 
sentence  contains  many  conceptual  subproposi t ions.  A  subproposition  ie 
any  unit  of  information  uhich  is  conveyed  directly  (without  non- 
anaiyzer-mi  tiated  inference)  by  a  conceptualization.  Subpropositions 
can  be  classified  into  three  categories:  (1)  explicit-focussed,  (2) 
expl  ici  t-peripherai  and  (3)  implicit.  Explicit  subpropositions  are 
always  r-mplete  conceptualizations,  whereas  implicit  subpropositions  are 
generally  communicated  through  single,  isolated  dependencies. 

To  illustrate  these  categories,  consider  the  sentence: 

"The  engine  of  Beverly’s  new  car  broke  doun  while 
she  wss  dr  ivng  on  the  freeway  late  last  night." 

The  exp1 ici t-focussed  proposition  is:  "a  car  engine  broke  uown".  This  is 
th,'  "main  reason'  for  the  conceptualization’s  existence.  It  is  not 
necessarily  always  the  most  interesting  subproposition  for  MEMORY  to 
pursue,  however. 

Some  of  the  explicit-peripheral  propositions  are: 

1.  the  car  is  new 

Z.  the  car  is  owned  by  Beverly 

3.  the  time  of  the  incident  was  late  iast  night 

4.  the  location  of  the  incident  was  on  the  freeuay 

5.  Beverly  was  driving  a  car 

These  are  aduitional  facts  the  speaker  thought  essential  to  the  hearer’s 
understanding  of  the  conceptualization.  They  are  "perioheral" 
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(dependent )  in  the  conceptual  dependency  sense,  and  for  the  purposes  of 


parsing.  However,  they  frequently  convey  the  most  interesting 
information  in  the  conceptualization. 

Some  of  the  implicit  propositions  are: 


1.  cars  have  engines  as  parts 

2.  people  oun  things 

3.  Beverly  performed  ar  action 

4.  cars  can  be  *PTRANS*ed  'i.e.  they  are  moveabie) 

5.  the  car,  engine  and  Beverly  were 

on  the  freeway  (i.e.  the  actors  and  objects  involved 
in  an  event  have  the  event's  location) 


Briefly,  these  are  very  low-level  propositions  which  affirm  conceptual 
case  restrictions,  and  which  must  strictly  adhere  to  MEMORY'S  knowledge 
of  normality  in  the  world.  Tnese  typically  lie  on  the  borderline  between 
what  was  said  and  what  the  hearer  nearly  always  infers  without  further 
thought. 

In  the  example  "John  hit  Mary",  the  fragmentation  process  yields 
the  following  subpropositions  from  the  input  conceptualization: 


1.  JOHN  PROPELLED  SOMETHING 

2.  A  I  "NO  UAS  PROPELLED 

3.  JOHN  MOVED  SOMETHING 

4.  A  HAND  UAS  MOVED 

5.  A  HAND  IS  PART  OF  JOHN 

6.  SOMETHING  UAS  PROPELLEO  FROM  JOHN  TO  MARY 

7.  A  HAND  AND  MARY  WERE  IN  PHYSICAL  CONTAPT 

8.  JOHN  PROPELLED  HIS  HAND 

9.  8  CAUSED  7 

10.  IT  UAS  BEFORE  "NOU"  THAT  1-9  OCCURRED 


Me  do  not  pursue  all  of  these  in  the  following  description,  but 
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bear  in  mind  that  RERORY  subjects  each  of  the  above  13  eubproposi t ions 
(some  of  which  are  redundant  in  the  information  they  convey)  to 
i nf erenc i ng. 

Having  been  "perceived"  externally,  the  causal  relation  (3  above) 
is  stored  as  a  superatom,  assianeci  strength  1.0.  given  TRUTH  T,  RODE  T 
and  REASONS  T  (there  are  no  reasons,  it  is  just  true).  In  addition,  its 
superatom  is  entered  on  the  inference  queue,  which  now  has  this  single 
entry.  Inferences  organized  under  CAUSE  are  then  called.  Two  nominal 
inferences  with  strength  propagation  factor  1.0  are  that  the  two  parts 
of  the  causal  relation  are  themselves  true:  the  PROPEL  and  PHYSCONT 
propositions  arc  thus  inferred  with  propagated  strength  still  1.0,  TRUTH 
T.  MODE  T  and  REASONS  a  list  of  one  item:  the  superatom  for  the  causal 
proposition.  In  addition  TIRE  propositions  are  created  for  these  two 
new  superatoms  using  8C0802.  These  receive  STRENGTH  1.0.  TRUTH  T.  RODE 
T,  having  as  REASONS  a  list  of  one  item  which  is  the  superator.  for  the 
causal  time  proposition.  These  two  neu  time  propositions  are  not, 
however,  added  to  the  inference  list.  The  PROPEL  proposition,  when 
subjected  to  nferercing  will,  among  other  things,  look  to  see  if  an 
instrumental  is  present,  and,  seeing  that  one  isn’t,  will  add  the  nost 
likely  one:  (ROVE  2  JOHN  0381  "JOHN  filARY) .  This  will  in  turn  be  added 
to  vhe  inference  queue.  Uhen  its  inferences  are  generated,  among  them 
will  be  the  inference  that  ffJOHN  has  at  least  one  movable  hand.  Uere 
RE RORY  to  find  a  contradiction  at  this  point,  it  would  have  access  to 
the  ROVE  completatory  inference  which  produced  the  contradiction,  and 
would  alter  its  strength  of  be' ief  and  note  that  a  contradiction  had 
occurred.  Later,  a  response  concerning  this  problem  might  be  gene~ated. 


Among  the  other  inferences  organised  under  CAUSE,  one  has  an 
invocation  pattern  which  is  matched  by  this  (CAUSE 
(PROPEL. ..)  (PHYSCONT. ..) )  patte-n.  This  '19  the  inference  that 
recognizes  that  someone’s  PROPEL t i ng  an  object  has  caused  the  contact  of 
that  object  with  an  an'mal.  The  inference  is  that  the  animal  is  likely 
to  have  been  hurt: 

13S) 

(NEGCHANGE  WARY  APSTATE! 

Notice  the  reason  for  organizing  this  inference  under  CAUSE  rather  than 
PROPEL  or  PHYSCONT:  FROPEL  alone  says  nothing  about  actual  contact,  only 
that  an  actor  has  propelled  an  object  in  a  direction.  PHYSCONT  alone  is 
not  enough,  because  it  also  appears  in  sentences  like  "Juhn  is  touching 
the  wall."  where  there  are  no  such  violent  dynamics.  This  pattern  also 
knows  that  the  outcome  of  a  propelling  which  causes  physical  contact  can 
lead  to  different  kinds  of  inferences  based  on  the  features  of  the 
propelled  object  and  the  target  object.  For  example,  it  knows  that  to 
hit  a  boc  y^rt  of  an  animal  is  the  sane  as  hitting  the  animal,  and  that 
a  measure  o*  tht  amount  of  injut  y  done  is  a  function  of  the  hardness, 
heavyr.ess,  sharpness,  etc.  of  the  propelled  object,  and  of  the 
part.cular  bodypart  hit. 

The  NEGCHANGE  inference  is  thus  stored  as  a  superatom  and  added  to 
the  inference  queue.  Its  REASONS  are  the  original  CAUSE  and  the  facts 
that  (ISA  WARY  ^PERSON)  and  USA  ^PERSON  AAN1HAL) .  Not  ice  that  the 
actual  inference  rule  is  not  recorded  as  3  reason,  since  a  semblance  of 
it  can  always  be  reconstructed  from  its  parts. 
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This  same  CAUSE  pattern  also  3ssei  ts  the  actor’s  ilition  since  it 
detects  no  information  to  the  contrary:  John  wanted  this  causal  relation 
to  exist.  This  is  a  general  operating  assumption  of  flEHORV :  that  it  is 
essential  at  every  point  in  inferencing  to  keep  track  of  the 

i  ntent ional  i  ty  of  actions.  Actions  which  stand  by  themselves  are  always 
assumed  to  be  voi  tional.  L-keise.  causal  relationships  such  as  this 

one  (where  an  action  causes  a  state),  are  assumed  to  be  the  result  of 

the  actor’s  volition.  (Deciding  an  actc.’s  intent  in  most  cases  is  a 
difficult  problem.  (31  discusses  problems  of  this  nature  in  seme 

de  t  a i I . ) 

At  this  point  (33)  is  stored  and  entered  on  the  inference  queue. 
Its  REASON  is  simply  the  original  superatom.  Notice  that  MEMORY  has  now 
made  an  important  distinction  between  the  physical  and  intentional 
components  of  the  event.  They  will  proceed  in  parallel. 

(39) 

(  01LOC  ((CANCAUSE  ( (NECCHANGE  RMARY  UPSTATE)) 

{(POSCHANGE  SjQHN  »J0Y)))) 

#C0083) 

(TINE  _  #C8002) ) 

(SC0003  is  John’s  LTD) 

Ue  return  now  to  (38).  iNEGCHANGE  WARY  WEALTH)  accesses 
inferences  organized  under  NECCHANGE.  HENDRY  first  checks  to  determine 
what  caused  this  situation  and  finds  the  REASONS  which  were  generated 
aiong  with  the  NECCHANGE.  Had  MEMORY  not  found  any  REASONS,  it  would 
have  attempted  to  apply  world  knowledge  to  m^ke  a  prediction.  This 
knowledge  is  stored  using  the  predicates  CAUSE  and  CANCAUSE,  and  ;$ 
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accessed  by  the  NENCRY  query:  find  all  probable  causes  of  (NEGCHANGE 
^PERSON  AfHEALTH) .  i.e.  find  all  X  such  that  (CANCAUSE  X  (NEGCHANGE 
^PERSON  AfHEAL  TH ) ) ,  and  similarly  for  CAUSE.  This  situation  would  occur 
in  the  following  type  of  story:  "Nary  was  hurt."  "John  had  hit  her  with 
a  rock."  where  one  member  of  the  predicted  set  is  borne  out  by  the  next 
line  of  the  story.  Such  a  process  is  called  "knitting"  (see  (3]),  and 
is  the  chief  measure  of  "understanding"  m  several-line  stories. 

in  addition  to  this  determination  of  causality  which  was  trivially 
satisfied  in  this  case.  MEfiORV  detects  appl icaoi I i ty  of  the  following 
belief  pattern:  when  a  person  undergoes  a  NEGCHANGE  (on  any  scale,  since 
all  scales  are  positive),  he  will  want  to  undergo  3  POSCHANGE  on  that 
scale.  NENORY  thus  infers  (40): 


(40) 

( (NLOC  ( (CANCAUSE  ( (POSCHANGE  WARY  WEALTH) ' 
((POSCHANGE  WARY  A'JOY)))) 

0C0004) 

(TINE  JYC000S)) 

AC0004  is  Nary’s  LTN, 
AC0035  is  (AFTER  C0002) 


This  subsequently  will  be  detected  by  the  belief  pattern 
(organized  under  NLGC)  that  when  a  person  wants  a  future  event,  he  will 
perform  some  action  to  try  to  achieve  that  event  or  state.  Once  again, 
CAUSE  and  CANCAUSE  information  is  called  into  play  to  predict  Nary’s 
likely  actions.  An  example  of  this  type  or  information  is: 

((CANCAUSE  ((INGEST  APERSON  WEOICINEi) 

((POSCHANGE  ^PERSON  WEALTH)))) 
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Using  information  collected  in  this  manner,  a  prediction  of  Mary’s 
future  actions  is  made.  Inis  prediction  has  the  form  of  a  bond,  and 
indicates  that  any  or  all  of  the  actions  listed  are  possible.  Notice 
that  only  actions  are  being  predicted,  if  some  causes  of  the  state  the 
actor  desires  are  not  actions  but  rather  states  or  statechanges 
themselves,  further  CANCAUSE  and  CAUSE  chains  are  considered  until  an 
action  is  found.  For  instance,  suppose  Mary  uants  a  NEGCHANGE  on  her  own 
health  scale.  One  cause  of  a  NEGCHANGE  on  the  health  might  be  to  have 
one’s  heart  in  PHYSCGN7  with  a  knife.  Since  this  is  not  an  action, 
memory  must  be  searched  for  things  which  could  cause  the  required 
PHYSCONT.  Among  them  would  be  the  action  of  PROPEL!  ing  the  knife  to  that 
location.  This  PRGpEl  might  then  bs  a  valid  action  prediction  for  Mary 
at  that  point. 

At  fhis  point,  (41)  is  generated,  and  inferencing  on  this  line  is 
stopped. 

(41) 

((PREDICT  I  ONSET  AMARY 

((INGEST  W1ARY  MEDICINE  AUNSPEC  AC0036) ) 

< (PTRAN5  Ad ARY  AM ARY  AUNSPEC  AC8307)))) 

where  C030G  is  Mary's  INSIDES. 

C3837  is  a  token  of  a  AHOSPITAl 

Ue  now  return  to  (33).  This  inference  accesses  the  belief  pattern 
organized  unJe"  MLOC  which  we  nave  labelled  VENGEANCE:  if  a  NEGCHANGE 
(on  any  scale)  of  a  persun,  PI,  would  cause  a  POSCHANGE  on  the  joy  scale 
for  someone  else,  P2,  then  P2  must  be  angry  at  Pi.  MEMORY  therefore 
infers  (4?): 
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(42) 


( (MFEEL  #JOHN  tfANC-EF  WARY )  (THE  _  CPC82) ) 


Stored  under  MFEEL  is  the  belief  pattern  that  the  reason  people  are  in  a 
state  of  directed  anger  toward  another  person  is  probably  that  the 
second  person  did  something  which  caused  d  NEGCHANGE  on  some  scale  of 
the  first  person.  MEMORY  first  looks  to  see  if  Mary  is  known  to  have 
done  something  which  caused  a  NEGCHANGE  in  John.  In  this  example  it 
finds  none.  Had  one  been  found  from  a  previous  sentence,  MEMORY  would 
have  again  "knitted1  one  n>»ce  o*  knowledge  with  an  existing  one.  In 
this  example,  having  found  no  actions  on  the  part  of  Mary,  MEMORY 
generates  a  predict ior.  about  Mary's  PAST  actions,  once  again  utilizing 
CAUSE  and  CANCAUSE  knowledge  of  the  world.  After  making  prediction  (43) 
MEMORY  also  poses  a  question  of  the  form;  "Uhat  did  Mary  do?",  stores 
the  question,  and  notes  its  potential  answer  as  being  of  interest  to  the 
prediction  just  made. 

(43) 

( (PREOICTIONSFT  WARY 

( (lAUSE  ( (PROPEL  WARY  £PHYS0BJ  HJNSPEC  ffJUHN) ) 

( (PHYSCONT  ffPHYSOBJ  ffJOHN)  i .» ) 

HATRANS  WARY  AFHYSOBJ  A  JOHN  WARY)))) 

i.e.  Mary  either  hit  John  first,  or  toon,  something  from  him.  (It 
should  be  clear  that  we  ars  not  intending  to  specify  an  exhaustive 
prediction  list.  Rather  we  seek  fo  demonstrate  the  PROCESSES  which 
occur  in  MEMORY.)  At  this  point  MEMORY  stops  inferencing  end  poses  the 
question  "Uhat  did  Mary  do  to  John?": 
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(44) 


((CAUSE  (00  W1ARY  *?*)  ( (NEGCHANGE  #J0KN  ^UNSPECIFIED) ) ) 

(TIME  _  C8010)) 

uhere  C0010  is  BEFORE  C000<u 

To  summarise,  MEMORY  has  taken  the  conceptual  analysis  underlying 
an  English  sentence  and  generated  neu  probabilistic  information  from  it 
in  an  attempt  to  relate  it  to  Knowledge  HEMORY  may  already  have  stored. 
The  new  information  took  three  basic  forms:  (a)  predictions  about  the 
causes  of  the  input,  (b)  predictions  about  the  possible  results  of  the 
input,  and  (c)  predictions  about  future  and  past  actions  of  people.  The 
effects  of  inferencing  are  seen  at  the  end  either  in  the  form  of  d 
question  or  a  comment  uhich  indicates  that  the  sentence  indeed 
interacted  with  some  of  MEMORY'S  knouledye  and  belief  patterns. 


APPENDIX  A 
(COMPUTER  EXAMPLES) 


Uhat  follows  is  output  from  the  MARGIE  system  currently  operating 
at  Stanford.  MARGIE  is  a  combination  of  three  programs  each  of  whose 
output  is  shown  here.  The  analysis  program  produces  conceptual 
structures  from  a  given  input  sentence.  The  memory  program  stores  this 
output  in  a  special  format  and  makes  inferences  about  based  on  its 
knowledge  of  the  world.  It  then  recodes  these  inferences  into  Conceptual 
Dependency  structures.  These  structures  are  then  read  by  a  generating 
program  that  codes  them  into  semant  ic  structures  that  are  Engl  is  based 
(after  Fillmore  (13).  A  modified  version  of  a  program  written  by 
Simmons  181,  then  encodes  these  structures  into  English. 

The  examples  presented  here  are  intended  only  to  show  the  flavor 
of  the  inference-making  program.  The  entire  system  is  quite  a  bit  more 
powerful  than  these  examples  demonstrate.  That  is  MARGIE  can  answer 
questions  about  what  it  has  been  told,  ask  questions  3bout  what  it  would 
like  to  know,  as  well  as  parse  sentences  more  complex  than  those  shown 
here.  Here  we  merely  want  to  indicate  the  inference  capability. 

In  the  interest  of  space,  ue  have  manually  edited  out  some  of  the 
less  interesting  (generally  repetitive  from  example  to  example) 
inferences.  This  explains  the  apparent  discrepancy  betueen  the  number  of 
"INFERENCES'1  and  "THINGS  TO  SAY"  in  the  foMouing  examples. 


TYPE  INPUT 
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* ( JOHN  TOLO  NARY  THAT  BILL  UANTS  A  BOOK) 


OUTPUT  FRON  PARSER: 

TIN00  :  ( ( VAL  *T*)) 

TIN01  :  ((BEFORE  TIN80  X)) 

TIN02  :  ((AFTER  TIN00  X)) 

TIN03  :  ((AFTER  TIN00  X)) 

TIi'104  :  ((AFTER  T1N00  X)) 

((ACTOR  (JOHN1 )  <=>  UMTRANS*)  TO  (*CP*  PART  (NARY1)  REF  (*TH£*) )  FRO- 
N  (*CP*  PART  (JOHN1)  REF  (*THE*))  NOBJECT  ((CON  ((CON  ((ACTOR  (*ONEl*~ 
)  <->  UATRANS*)  OBJECT  (BOOK1  REF  (*A*))  TO  (BILL1)  FRON  (*0NE1*))  T- 
INE  (TIM04) )  <aC  ((ACTOR  (BILL1)  <s>T  (*JOY*)  <a>F  f*JOY*))  INC  (2)  T- 
INE  (TIN03) ) ) )  < 2 >  (*MLOC*  VAL  (*L Til*  PART  (BILL1)  REF  (*THE*))))  MOO- 
E  (NIL)  FOCUS  ( (<s>  VAL  PART))  TIME  (TIN00)))  TINE  (TIN01) ) 


PARTIALLY  INTEGRATED  RESULT: 

( (#:NTRARS*  (//J0HN1)  ( (*MLOC*  ( (CANCAUSE  ( (*A TRANS*  (//SOMEONE)  (G0012)- 
(//SOMEONE)  (A'BilLl) )  (TINE  (G0614)))  ( (STATECHANGE  (//BILL1)  (//JOY)- 
//UNSPECIFIED  //UNSPECIFIEO)  (TINE  _  (G0017) )  (INC  _  W/TUO) ) ) ) )  (G0013- 
))  (TINE  _  (G0015) ) )  (G0022)  (G002S) )  (TINE  _  (G0028))) 

INTEGRATION  RESULT:  C0033 

INFERENCES: 

(G0040  G0036  G0047  G0057  G0056  G0055  G0053  G0052  GB065  G0070) 


THINGS  TO  SAY: 

((ACTOR  (BOOK  REF  :*A*) )  <*>  (*XABT*  VAL  <*?*)))) 


(A  BOOK  ABOUT  UHAT) 


( (CON  ( (CON  ( (ACTOR  (NARY)  <«>  (*ATRANS*)  OBJECT  (BOOK  REF  (*A*) )  FRO- 
N  (NARY)  TO  (BILL) )  TINE  (G0014)  FOCUS  ((ACTOR)))  <«C  ((ACTOR  (JOHN)  - 
<g>F  <*JOY*/  <s>T  (♦JOY*))  TIME  (G0017)  INC  (2))))  <s>  (*MLOC*  VAL  (*- 
LTN*  REF  (*A*)  PART  (JOHN))))  CERTAINTY  (0.8)  TIME  (G0015)) 
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(JOHN  POSSIBLY  UANTS  MARY  TO  GIVE  BILL  A  BOOK) 


((CON  ((CON  ((CON  ((ACTOR  (*QNE1*)  <=>  (*ATRANS*)  OBJECT  (BOOK  REF  (*- 
A*))  FROM  (*ONEl*)  TO  (BILL))  TIME  (C0814)  FOCUS  ((ACTOR)))  <»C  ((ACT¬ 
OR  (BILL)  <s>F  (*JGY*)  <2>T  (*JQY*) )  TINE  (G8017)  INC  (2))))  <*>  (*ML- 
CC*  VAL  (*LTf1*  REF  (*A*)  PART  (BILL))))  TINE  (G0015) )  <■>  (*MLOC*  VAL¬ 
UER*  REF  (*A*)  PART  (NARY))))  TS  (00028)) 


(NARY  EXPECTED  BILL  TO  UANi  A  BOOK) 


((CON  ((CON  ((ACTOR  UON'Ei*)  <=>  UATRANS*)  OBJECT  (BOOK  PEF  (*A*))  F- 
RON  (*0NE1*)  TO  (BILL))  TINE  (G0014)  FOCUS  ((ACTOR)))  «C  ((ACTOR  (BI¬ 
LL)  <a>F  (*JOY*)  <3>T  (*JOY*)>  TINE  (G0017)  INC  (2))))  <*>  (*MLOC*  VA- 
L  (*LTN*  REF  (*A*>  PART  (BILL))))  TINE  (G0015)) 


(BILL  UANTS  A  BOOK) 


((CON  ((CON  ((CON  ( (ACTOR  (*DNE1*)  <«>  (*ATRANS*)  OBJECT  (BOOK  REF  (*- 
Ax-))  FROM  (*QNE1*)  TO  (BILL) )  TINE  (G001  .I'T  l  (ACTOR)  <sC  ((ACT¬ 
OR  (BILL)  < 2 >F  (* JOY* )  <s>T  (*JQY*))  TINE  (G0017)  INC  (2))))  <a>  (#ML- 
OC*  VAL  (*L7N*  REF  l*A*)  PART  (BILL’D))  TINE  (G0015) )  <*>  (*MLOC*  VAL- 
(-.L  TM*  REF  (*A*)  PART  (NARY))))) 


(NARY  KNCUS  BILL  HANTS  A  BOOK) 


((ACTOR  (NARY)  <=>  UATRANS*)  OBJECT  (BOOK  REF  (*A*>)  FRON  (MARY)  TO  - 
(BILL))  TINE  (G0017)  CERTAINTY  (0.8)) 


(NARY  NIGHT  GIVE  BILL  A  BOOK) 


((CON  ((CON  ((ACTOR  (BOOK  REF  (*A*) )  <s>  (*POSc>*  VAL  (BILL)))  TS  (G00- 
14)  TINE  (00066) )  <sC  ((ACTOR  (BILL)  «>F  (*J0.*)  <*>T  (*JOY*! )  INC.  (- 
2)  TINE  (G00G7DI)  <=>  (*MLOC*  VAL  (*LTM*  PART  (BILL)  REF  (*THE*) ) ) ) ) 


(BIlL  THINKS  HE  UOULO  LIKE  TO  CONE  TO  HAVE  A  BOOK) 


((CON  ((CON  ((ACTOR  (BOOK  REF  (*A*))  <*>  UPOSS*  VAL  (*ONEl*)))  TF  (G- 
0014)  TIME  (G0070) )  <«C  ((ACTOR  (BILL)  <a>F  (*JOY*)  <«>T  (*JOY*>)  INC- 
(2)  TIME  (G0071 ) ) ) )  <b>  (*MLOC*  VAL  (*LTM*  PART  (BILL)  REF  (*THE*>))- 
) ) 


(BILL  THINKS  HE  WOULO  LIKE  SOMEONE  TO  CEASE  TO  HAVE  A  BOOK) 


((CON  ((CON  ((ACTOR  UONE1*)  <■>  (*PTRANS*)  OBJECT  (BOOK  REF  (*A*) )  F- 
RCfl  (*ONEl*)  TO  (BILL))  FOCUS  ((ACTOR))  TIME  (G8074) )  <«C  ((ACTOR  (BI¬ 
LL)  <2>F  (*JOY*)  <h>T  (*JOY*) )  INC  (2)  TIME  (G007S))))  <«>  (*MLOC*  VA- 
L  (*LTM*  PART  (BILL)  REF  (*THE*))))) 


(BILL  WANTS  TO  GET  A  BOCK  PROM  SOMEONE) 


((CON  ((CON  ((ACTOR  (BOOK  REF  (*A*))  <a>  (*LOC*  VAL  (BILL)))  TS  (G081- 
4)  TIME  (G0078) )  <sC  ((ACTOR  (BILL)  <=>F  (*JOY*)  <a>T  (*JOY*))  INC  (2- 
)  TIME  (G8073)i))  <3>  (#MLOC*  VAL  (*LTM*  PART  (BILL)  REF  (*THE*))))) 


(BILL  THINKS  HE  UOULG  LIKE  A  BOOK  TO  COME  TO  BE  NEAR  HIM) 


((CON  ((CON  ((ACTOR  (BOOK  REF  (*A«) )  <a>  (*LOC*  VAL  (*ONEl*)))  TF  (GB- 
014)  TIMS  (G8082) )  <=C  ((ACTOR  (BILL)  <a>F  UJOY*)  <e>T  (*JOY*) )  INC  - 
(2)  TIME  (08083))))  <*>  UMLGC*  VAL  (*LTM*  PART  (BILL)  REF  (*THE*))))- 
) 


(BILL  THINKS  HE  WOULD  LIKE  A  BOOK  TO  CEASE  TO  BE  NEAR  SOMEONE)  , 


((CON  ((CON  ((ACTOR  (BILL)  <«>  (*MTRANSw)  MOBJECT  ^CONCEPTS*)  FROM  (- 
BOOK  PEr  (*A*))  TO  (*CP*  PART  (BILL))  INST  ((ACTOR  (BILL)  <->  (*LOOK_- 
AT*)  08JECT  (BOOK  REF  (*A*)))))  FOCUS  ((ACTOR))  TIME  (G088S))  <eC  ( (A- 
CTOR  (BILL)  <=>F  (*JOY*)  <s>T  (*JOY*))  INC  (2)  TIME  (G00S7) ) ) )  <■>  (*- 
I1L0C*  VAL  (*LTM*  PART  (BILL)  REF  (*THt»  ) ) ) ) 


(BILL  WANTS  TO  READ  A  BOOK) 
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TYPE  INPUT 
* (JOHN  HIT  NARY) 


OUTPUT  FROM  PARSER: 

T 1 1190  :  ( (VAL  *T*)> 

TIM01  :  ((BEFORE  TIN00  X!) 

((CON  ((ACTOR  (JOHN1)  <»>  UPROPEL*)  OBJECT  <*HAND*  PART  (JOHN1) )  TO  - 
(MARY1 )  FRON  (JOHN1)  INST  ((ACTOR  (JOHN1)  <■>  (*NOVE*)  OBJECT  (*HAND*- 
PART  ( JOHN1) ) ) i )  TINE  (TIH01)  NODE  (NIL))  <s  ((ACTOR  (*HAND*  PART  (Jv 
OHN1) )  <a>  (*PHYSCONT*  YAL  (NARYl) ) )  TINE  (TIN01)  NODE  (NIL)  FOCUS  IC¬ 
ON  AC  rOR) ) ) ) 


PARTIALLY  INTEGRATED  RESULT: 

((CAUSE  ( i*PROPEL*  (tfJOHNl)  (G0003>  WJOHN1)  (tflARYl))  (TINE  (G0012- 
))  (INST  _  ((*f10VE*  (0JOHNI)  (G0809)  (^UNSPECIFIED)  OKUNSPCCIFItD) ) ) )- 
)  (UPHYSCONT*  (G0099)  (M1ARYD)  (TiNE  _  (G0012) ) ) ) ) 

INTEGRATION  RESULT:  G0821 


INFERENCES: 

(G0023  G0022  G0016  G0013  03024  G002G  G0027) 


THINGS  TO  SAY: 

((CON  ((CON  ((ACTOR  (NARY)  <*>F  (ESTATE#)  <«>T  (*PSTATE#))  INC  (-2/  - 
CERTAINTY  (1.0)  TINE  (G8031))  <«C  ((ACTOR  (JOHN)  **>F  (*JOY*)  <*>T  (*- 
JOY*) )  INC  (2)  TINE  (G0832) ) ) )  <»>  UNLOC*  VAL  (*LTf1*  PART  (JOHN)  REF- 
(*THE*))))  CERTAINTY  (1.0)  TINE  (G0012)) 


(JOHN  WANTED  NARY  TO  6ECCNE  HURT) 


((ACTOR  (NARY)  <«>F  UPSTATE*)  <s>T  (ESTATE*))  INC  (-2)  CERTAINTY  (1~ 
.0)  TINE  (G0012) ) 


(NARY  BECANE  HURT) 


■-J 


( (ACTOR  (JOHN)  (*PROPEL*)  OBJECT  (*HAND*  REF  («A»)  PART  (JOHN))  F- 
ROM  (JOHN)  TO  (MARY)  INST  ((ACTOR  (JOHN)  <•>  UNOVE*)  OBJECT  (*HAND*  ~ 
REF  (*A*)  PART  (JOHN))  FROM  (*ONE*>  TO  (*ONE*))  FOCUS  ((ACTOR))))  Tin~ 
E  (G0012)  FOCUS  (<A-7C.R))  CERTAINTY  (1.0)) 


(JOHN  SWUNG  HiS  HAND  TOWARD  MARY) 


((ACTOR  UHANO*  REF  (*A*)  PART  (JOHN))  o>  (*PHYSCONT*  YAL  (NARY)))  T«. 
HIE  (G0012)  CERTAINTY  (1.0)) 


(JOHNS  HAND  TOUCHED  NARY) 


( (ACTOR  (JOHN)  <-  (*NFEEL*)  N03JECT  (* ANGER*)  TO  (NARY))  FOCUS  ((ACT- 
OR))  CERTAIN! V  (1.0)  TINE  (G8012)) 


(JOHN  WAS  ANGRV  AT  NARY) 


(ICON  ((CON  ((ACTOR  (NARY)  <s>F  (*PS7ATE*)  <*>T  (*PSTATE*7 »  INC  (2)  Tv 
HE  (G083S) )  <sC  ((ACTOR  (NA-Y)  c£>P  UJOY*)  <«>T  (*JOY*  )  INC  (2)  TI¬ 
NE  (G0C3S) ) ) )  <=>  (*NLOC*  VAL  (*LTN*  PART  (NARY)  REF  (*THE«) ) ) )  CERTA¬ 
INTY  (1.0)) 


(NARY  W'  TS  TO  FEEL  61. TER) 


((CON  ( (ACTOR  (NARY)  <»>  (*?*))  TINE  (G0028)  FOCUS  ((ACTOR))  CEPTAINT* 
Y  (1.8))  <=  ((ACTOR  (JOHN)  <s>T  (*ONE»)  <a>F  (*ONE*) !  INC  (-2)  TINE  U 
G00285  FOCUS  (ACTOR)) 


'WHAT  DIO  NARY  DO  TO  JOHN) 


TYPE  INPUT 

* ( JOHN  '.DVISEu  NARY  TO  SELL  BILL  A  BANANA) 


50 


# 

* 


OUTPUT  FROM  PARSER: 

Tinea  :  ( <val  *t*h 
TIM01  :  ( (BEFORE  TIM00  X)) 

T 11102  :  ((AFTER  TIM01  XJ) 

T IM03  :  ( v VFTER  TIH01  X)) 

((ACTOR  ( JOHN  1 )  <=>  (*M TRANS*)  TO  (*CP*  PART  (MARY1)  REF  (*THE*) )  FRO- 
fl  (*CP*  PART  (JOHN!)  REF  (*THE*) )  ROBJECT  ((CON  ((CON  ((ACTOR  (MARY1)- 
<«>  (*A TRANS*)  OBJECT  (BANANA!  REF  (*A*))  TO  (BILL1 )  FROfl  (flARYl) )  T- 
IME  ( T !  f103 ) )  <ss>  ((ACTOR  (B1LL1)  <«>  (*4TRANS*)  OBJECT  (*MONEY*  REF  ~ 
(*A*) )  TO  (flARYl )  FROM  (BILL1) )  FOCUS  ((CON  ACTOR1)  TIME  (TIf103) ) ) )  <- 
eC  ((ACTOR  (MARY1)  <a>T  (*JOY*)  <s>F  (*JOY*) )  INC  (2)  TIDE  (TIM02)  MO¬ 
DE  (NIL)))))  FOCUS  ((ACTOR))  MODE  (NIL)  TIME  (TIM01.) 


PARTIALLY  INTEGRATED  RESULT: 

( (*M TRANS*  (tf JOHN 1 )  ( (CANCAUSE  t (DUALCAUSE  ( (*ATRANS*  (W1ARY1)  (G0024- 
)  (tf flARYl )  (A'BILLl ) )  (TIME  _  (G030S*  ? )  ( (*A TRANS*  (tfBILLl)  (G0013)  (#- 
BILL!)  OSMARYD)  'TIME  (G0006)))))  ( (STATECHANGE  (#MARl'l)  (#JOY)  £U- 
NSPECIFIEO  -UNSPECIFIED)”  (TIME  _  (G301S))  (INC  _  OSTUO)})))  (GB017)  (~ 
GO020) )  (TIME  _  (G0007H) 

INTEGRATION  RESULT:  G0332 

INFERENCES: 

(G0043  G004S  G0040  G0031  G0866  G0023  G00SG  G8083  G0084  G0099  G0100) 

THINGS  TO  SAY: 

((CON  ((CON  ((CON  ( (ACTOR  (MmRY)  v  =  >  (*ATRANS*)  OBJECT  (BANANA  REF  {*- 
A*))  FROM  (MARY)  TO  (BILL))  TiME  (G000S)  FOCUS  ((ACTOR))  CERTAINTY  (1- 
,0))<=9>  ((ACTOR  (BILL)  <»  (*ATRANS*)  OBJECT  (*MONEY*  REF  (*A*) )  FR¬ 
OM  (BILL)  TO  (MARY)',  TIME  (GB008)  FOCUS  ((ACTOR)))))  <«C  ((ACTOR  (MAR- 
Y)  <«>F  (*ONE*  <e>T  (*ONE*))  TIME  (G0815)  INC  (2)))  CERTAINTY  (1.0))- 
< s >  (*riLOC*  VAL  (*LTM*  REF  (*A*)  PART  (JOHN))))  TIME  (G0007)  CERTAIN¬ 
TY  (1.0)) 


(JOHN  BELIEVES  THAT  MARY  UOULO  BENEFIT  BY  MARY  SELLS  BILL  A  BANANA) 


((CON  ((CON  ((CON  ((ACTOR  (MARY)  <=>  (*ATRAN3*)  OBJECT  (BANANA  REF  (*- 
A*))  FROM  (MARY)  TO  (BILL))  TIME  (G0336)  FOCUS  ((ACTOR))  CERTAINTY  (1- 
.0))<Ea>  ((ACTOR  (BILL)  <«>  (*ATRANS*)  OBJECT  (*MONEY*  REF  (*A*))  FR- 
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on  (BILL)  TO  (MARY) )  TIME  (G888S)  FOCUS  ((ACTOR)))))  <.C  ((ACTOR  (MAR- 
Y)  <«>F  (♦ONE*)  <=>T  (*ONE*))  TIME  (G001S)  INC  (2)))  CERTAINTY  C..0)K 
<i>  (*f1LOC*  VAL  (*CP*  REF  (*A*)  PART  (MARY))))  TS  (00087)  CERTAINTY  ~ 
(1.0)) 


( MARY  BEGAN  THINKING  ABOUT  MARY  SELLS  BILL  A  BANANA  BENEFITS  MARY) 


((CON  ((CON  ((ACTOR  (MARY)  <->  (*A TRANS*)  OBJECT  (BANANA  REF  (*A*) )  F~ 
ROM  CARY)  TO  (BILL))  TIME  (G9886)  FOCUS  ((ACTOR))  CERTAINTY  (1.0))  <~ 
*«>  ((ACTOR  (BILL)  <->  (*ATRANS*)  OBJECT  (*MONEY*  REF  («A«) )  FROM  (Bl~ 
LL)  TO  (MARY) )  TIME  (08036)  FOCUS  ((ACTOR)))))  <»C  ((ACTOR  (HARY)  <b>~ 
F  («0N=«)  <«>T  (*CNE*>>  TINE  (60015)  INC  (2)))  CERTAINTY  (1.0)) 


(MARY  CAN  BENEFIT  FRON  NARY  SELL  BILL  A  BANANA) 


((ACTOR  (MARY)  <=>  UMBUILD*)  FROM  CCAcTOR  (MARY)  <->  (*ATRANS*)  OBJE¬ 
CT  (BANANA  REF  (*A*))  FROM  (MARY)  TO  (BILL) )  Tide  (G8088)  FOCUS  ( (ACT¬ 
OR)  )  CERTAINTY  (1.0))  TO  (*ONE*) )  CERTAINTY  (1.0)) 


(NARY  CCNS10ERE0  GIVING  BILL  A  BANANA) 


((ACTOR  (MARY}  <=>  UATRANS*)  OBJECT  (BANANA  REF  (*A*J )  FROM  (MARY)  7- 
0  (BILL)'  TIME  (G8833J  FOCUS  ((ACTOR))  CERTAINTY  (3.63)5 


(NARY  POSSIBLY  WILL  GIVE  BILL  A  BANANA) 


((CON  ((CON  ( (ACTOR  (BILL)  <«>  (cATRANS*)  OBJECT  (MONEY  REF  (*A*)}  FR¬ 
OM  (BILL)  TO  (MARV) )  I! ME  (G0033>i  <*C  ((ACTOR  (MARY)  <a>F  (*0NE*5  <«- 
>T  (*CNE*5)  TIME  (G8833)  INC  (2i ) > )  <e>  (*MLOC*  VAL  (*LTH*  REF  (*A*5  - 
PART  (JOHN))))  TIME  (G80eS‘  CERTAINTY  (0,58)) 


(JOHN  POSSIBLY  BELIEVES  THAT  MARY  UOULG  BENEFIT  FROM  BILL  GIVE  MARY  H~ 
ONEY) 


((CON  ((CON  ( (ACTOR  (MARY)  <->  (*ATRANS*5  OBJECT  (BAN ANN  REF  (*A*) )  F- 
RnM  (MARY)  TO  (BILL) )  TIME  (60033) )  <aC  ((ACTOR  (BILL)  <s>F  {♦ONE*)  <- 
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s > T  (*CNE*))  TIME  (G0833!  INC  (2))))  <*>  (*MLOC*  VAL  (*LTM*  REF  (*A») 
PART  (JOHN))))  T I  HE  (G0086)  CERTAINTY  10.50)) 


(JOHN  POSSIBLY  BELIEVES  THAT  BILL  UOULD  BENEFIT  FROfl  DARY  GIVE  BILL  A~ 
BANANA) 


((CON  ((CON  ((ACTOR  (BILL!  <->  (*INGEST*)  OBJECT  (BANANA  REF  UA*)))  - 
TINE  (G083A))  <aC  '(ACTOR  (BILL)  <=>F  (*JOY*)  <«>T  (*JOY*))  TIME  (G00~ 
34)  INC  (2))))  <s>  UMLOC*  VAL  <*LTf1*  REF  (*A*)  PART  (BILL))))  TINE  (~ 
GC006)  flOOE  ((*?*))> 


(00E3  BILL  UANT  TO  EAT  A  BANANA) 


TYPE  INPUT 

* ( JOHN  PREVENTED  MARY  FROM  HITTING  BILL  BY  CHOKING  FIARY) 


OUTPUT  FROM  PARSER: 

T I MB0  :  ((VAL  *r*)) 

T IM01  :  ((BEFORE  TIM00  Xii 
T;M02  j  ((BEFORE  T if10i  X)) 

((CON  '  (CON  ( (ACTOR  (JOHN!)  <=>  (*GRaSP*)  OBJECT  UNECK*  PART  (MARYl )~ 

) )  tine  (Tina:))  <3  ((actor  (maryd  <«>  uingest*)  object  (*air*  ref  - 
(*A*M  FROM  »*nOUTH*  PART  (MARYl)?  TO  MHS1DE*  PART  (flARYl ) ) )  TIDE  (~ 
7 10025  MODE  ( (*CANNOT*) )  5 )  FXUS  (CON  ACTOR))  a  '(CON  ((ACTOR  (MARY1)~ 
<=■>  (*!NGEST*)  OBJECT  (*AIR*  REF  (*A*j)  FROM  (*MOUTH*  PART  (MARY1) )  - 
TO  (*JNS(OE*  PART  (MARYl)))  T I  ME  t  T  i  H02 )  MODE  I (*CANNOT») ) )  <*  ((CON  ~ 
((ACTOR  (MARYl)  <«>  UPROPEL*)  OBJECT  (*HANO*  PART  (MARYl))  TO  (BILL1— 
)  FROM  (MARYl)  INST  ((ACTOR  (MARY!)  <»>  (*MOVE*)  OBJECT  (*HANQ*  PART  - 
(MARYl)))))  TIME  (TIMB1)  MODE  ( uCANNOU) ) )  <«  ((ACTOR  (*H  AND*  PART  U 
MARYl  i)  <5>  UPHYSC0NT*  VAL  (8ILL15))  TIME  (TIM81)  MODE  ( (*CANNOT») )  ~ 
FOCUS  (Cnw  ACTOR)!)  MODE  M*NEG*))M  FOCUS  ( (CON  ACTOR) ))) ) 


PARTIALLY  INTEGRATED  RESULT: 


( ( ANCX  ((CAUSE  i(*GRASP*  'ffJCHNli  (G0832))  (TIME  (G000S)))  ((CANNOT- 
( (*INGE5T*  (AT1ARY1)  (G0012)  (G081G)  (C-0021))  (TIME  _  (G0005) )*))))  U 
(CAUSE  ((CANNOT  ( (*1NGEST*  (AM ARY  1 )  IG0312)  'G0316)  (G0021))  (TIME  - 


(G0805) ) ) )  1  (SNOT  ((CAUSE  ((CANNOT  tt^OPtL*  (tflARYl)  (G8024!  (tflARY. 
1)  (0BILL1) )  (TINE  (G0906))  (INST  ( i«M0VE*  (JWARY1J  (08824}  OtflJNS- 
PECIFIEO)  (^UNSPECIFIED) )>))»)  ((CANNOT  ((*FHYSCON7*  iG8024)  (#BILL1)- 
J  (TIME  _  (G808G) )})})) !!>)») 

INTEGRATION  RESULT:  G0047 


INFERENCES: 

(G0032  G004G  G3027  G0031  G003S  G004S  G00S3  G8358  G08S6  G0079  G0070  G0- 
074  G0079) 


THINGS  TO  SAY: 

( (CON  ( (ACTOR  (JOHN*  <->  (*GRASP*)  OBJECT  (*NECK*  REF  (*A*)  PART  (MAR- 
Y))}  TINE  (G008S)  FOCUS  ((ACTOR))  CERTAINTY  (1.0))  <»  {(ACTOR  (NARY)  * 
(^INGEST*)  OBJECT  (*AIR*  REF  <*A*))  FRON  (*MOUTH*  REF  (*A*))  TO  {- 
★  INSIDE*  REF  (*A*f ) )  TINE  (G0005)  FOCUS  ((ACTOR);  NODE  { (*CANNOT*) )  C- 
ERTAINTY  (1.0)))  CERTAINTY  (1.0)) 


(JOHN  CHOKED  NARY) 


((CON  ((ACTOR  (NARY)  <»>  !*!NGES7*)  OBJECT  (*AIR*  REF  (*A*))  FRON  (*N- 
OUTH*  REF  (*A*) }  TO  UINS10E*  REF  (*A*)))  TINE  (08905)  FOCUS  ( (ACTOR)- 
)  NODE  ( (*CANNOT*) !  CERTAINTY  (1.9))  <E  ((CON  ((ACTOR  (NARY)  <«>  (*PR- 
OPEL*)  OBJECT  (*HAND*  REF  (*A*J  PART  (NARY))  FRON  (NARY)  TO  (BILL)  IN¬ 
ST  ((ACTOR  (NARY!  <  =  >  (*NQV'E*)  OBJECT  (*HAND*  REF  (*A«)  PART  (NARY))  - 
FRON  (*ONE*)  TO  - *ONE*)>  FOCUS  ((ACTOR))))  TINE  (08036)  FOCUS  ((ACTOR- 
))  NODE  ( (*CANN0‘ :  »)  <*  ((ACTOR  UhAND*  REF  (*A«)  PART  (NARY) ) ■ <b>  (-  . 

♦PHYSCONT*  VAL  ^  CL)))  TINE  (G088G)  NODE  ( <*CANNOT*) ) ) )  NODE  < (*NEG*~  * 

))  CERTAINTY  !l.0)))  CERTAINTY  (1.0))  * 


(NARY  NOT  HIT  SILL  BECAUSE  NARY  UAS  UNABLE  10  BREATHE) 


((ACTOR  (JOHN)  <->  (*GRASP*)  OBJECT  (★NECK*  REF  (*A*>  PART  (NARY)))  T- 
INE  (G808S)  FOCUS  ((ACTOR))  CERTAINTY  (1.8)) 


(JOHN  GRABEO  MARYS  NECK ) 


((ACTOR  (NARY)  <->  (# INGEST*)  OBJECT  (*AIR*  REF  (*A*))  FRON  (nflQUTH*  - 
PEF  (*A*) )  TG  (* I  NS IDE*  REF  (*A*)))  TINE  (G0885)  FOCUS  ((ACTOR))  NODE- 
U*CANNQT*))  CERTAINTY  (1.0)) 
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(MARY  WAS  UNABLE  TO  BREATHE) 


((ACTOR  (MARY)  <s>F  i*PSTATE*I  <a>T  (*PSTATE*))  INC  (-2)  TIDE  (GB005)- 
CERTAINTY  (1.8)) 

(MARY  BECAME  HURT) 


( (CQN  ((ACTOR  (MARY)  <«>  (*PR0PtL*)  OBJECT  (*KAND*  REF  (*A*)  PART  (NA- 
RY))  FROM  (MARY)  TO  (BILL)  i KST  ((ACTOR  (MARY)  <■>  (*MGVE*)  OBJECT  (*~ 
HAND*  REF  (*A*)  PART  (MARY))  FROM  (*ONE*)  TO  (*GME*))  FOCUS  ( T  ACTOP) )  ~ 
))  TIME  (G808R)  FOCUS  ( (ACTOR))  MODE  ( l*CANNQT*) ) )  ((ACTOR  (#HAND*- 
REF  (*A*  PART  (MARY))  <s>  (*PHYSC0N7*  VAL  (BILL)))  TIME  (G800E)  MOO* 
t  ((*CANM)7*))))  MODE  < (*NEG*) )  CERTAINTY  (1.0)) 


(MARY  NOT  HI T  BILL! 


((CON  ((CON  ((CON  ('ACTOR  (MARY)  <->  '*PROPEL*)  OBJECT  (*HAND*  REF  (*- 
A*)  PART  (MARY!)  FROM  (MARY)  TO  (E ILL) 1  TIME  (G0985))  <s  ((ACTOR  (*HA~ 
ND*  REF  (*A*)  PART  (MARY))  <s>  (*?HYSCONT*  VAL  (BILL)))  TIME  (G088SH- 
))  <sC  ((ACTOR  (MaRYs  <sF  (*JOY*;  <a>T  (*JOY*)>  INC  (2))))  <s>  (*MtOC~ 
*  VAL  (*LTM*  PART  (MARY)  REF  (*THE*M))  CERTAINTY  (1.0)  TIME  (G8885)) 


(MARY  WANTED  TO  HIT  BILL) 


((CON  ( (CCN  ((ACTUR  (BILL)  <*>F  !*PSTATE*)  <a>T  (*P$TATE*))  INC  (-2)  «* 
CERTAINTY  (1.8)  TIME  (G083S)>  <sC  ((ACTOR  (MARY!  <b>F  (*J0Y*»  <b>T  (*~ 
JOY*))  INC  (2)  TIME  (G003G) ) > )  <$>  (*MLOC*  VAL  (*LTM*  PART  (MARY)  REF- 
;*THE*))))  CERTAINTY  (1.8)  TIME  (G0005) ) 


(MARY  WANTED  BILL  TO  BECOME  HURT) 


( (ACTOR  (MARY)  <*>  (*MFEEL*)  MQBJECT  (*ANGER*)  TO  (BILL))  FOCUS  ((ACT¬ 
OR))  CERTAINTY  (1.0)  TIME  (G883S)) 


(MARY  WAS  ANGRY  AT  BILL) 
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((CON  ((ACTOR  (BILL)  <->  (*?*)>  TINE  (G0028)  FOCJS  ((ACTOR))  CERTAINT-v 
Y  (1.0))  <•  ((ACTOR  (NARY)  <*>T  (*ONE*>  <«>F  (*ONE*))  INC  (-2)  THE  U 
G0028)  FOCUS  (ACTOR)) 


(WHAT  OIO  BILL  DO  TO  NARY) 


((ACTOR  (JOHN)  <»>  (*NFEEl*)  NOBJECT  { DANGER*)  TO  (NARY))  FOCUS  ( (ACT* 
OR))  CERTAINTY  '0.8)  TS  (G0?0S)) 


(JOHN  POSSIBLY  BECANE  ANGRY  AT  NARY) 


A£Efcl£Li^ 

(INFERENCE  AND  REFERENCE  fS'A&LiSMhENTl 


We  include  this  appendix  to  illustrate  briefly  how  infererues  are 
useful  in  establishing  references  to  tokens  of  real  world  concepts,  A 
scheme  has  been  devised  which  permits  HENORY  to  proceed  with  other 
aspects  of  "understanding"  even  though  all  re'erents  may  not  have  been 
established  before  understanding  begins.  This  scheme  also  provides  for 
the  eventual  establishment  of  these  referents  as  another  goal  of  the 
inference  process,  it  is  not  hard  to  see  that,  in  general,  the  solution 
of  the  reference  problem  for  some  concept  can  involve  arbitrarily 
intimate  and  detailed  interaction  with  the  deductive  processes  of 
HEH0RY,  and  that  these  processes  must  be  designed  to  function  with 
concepts  whose  features  are  not  completely  known. 

Consider  the  sentence 


"Andy's  diaper  is  wet." 

Assume  a  very  simple  situation  for  the  sake  of  example:  that  MctlORY 
knows  of  exactly  two  concepts,  MCI,  HC2  such  that 

X  t  inCl.MCZI: 

(Dl)  USA  X  //PERSON) 

(02)  (NANE  X  "ANDY") 


(ie.  MEMORY  knows  two  people  by  the  name  Andy).  However,  possibly  in 
addition  to  much  other  information,  MEMORY  also  knows 

(AGE  MCI  012MONTHS) 
and  (AGE  MC2  025VEARS). 

This  is  a  typical  reference  dilemma:  no  human  hearer  would  hesitate  in 
the  correct  identification  of  "Andy"  ir  this  sentence  using  these  pieces 
of  knowledge  (in  no  particular  context).  Yet  the  natural  order  of 
"establish  references  first,  then  infer"  simply  does  not  work  in  this 
case.  !  n  order  to  oegin  inferer  c  'ng.  the  referent  of  "Andy"  is  required 
(ie.  access  to  the  features  of  Cl  in  memory),  but  in  order  to  establish 
the  referent  of  "Andy"  some  level  of  deduction  must  take  place.  This  is 
something  of  a  paradox  on  the  surface. 

Actually,  the  fault  lies  in  the  assumption  that  reference 
establishment  and  inferencing  are  distinct  and  sequential  processes.  The 
incorrectness  of  this  assumption  is  but  another  example  of  the  recurring 
theme  that  NO  aspect  of  natural  language  processing,  (from  phonology  to 
story  comprehension),  can  be  completely  compartmentalized.  In  reality, 
reference  establishment  and  inferencing  are  in  general  so  intimately 
interrelated  so  as  to  be  functionally  almost  indistinguishable. 
Nevertheless,  there  is  an  interesting  sequence  of  processing  which  will 
solve  this  class  of  reference  problem. 

(Ue  point  out  that  there  are  many  other  interesting  inferences  to 
be  made  from  this  sentence.  A  glaring  one  is.  of  course  "what  kind  of 
fluid'"  The  inference  which  supplies  this  information  is  an  example  of 
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LINGUISTIC-INFERENCE.  and  is  quits  simlar  to  the  casts  m  which  "hand" 
is  inferred  as  the  missing  object  implied  by  "hit".  One  difference  ie 
that,  while  "hand"  is  predicted  from  an  ACT,  "urine"  is  predicted  from  a 
PP,  namely  ''diaper".  Another  difference  is  that  "hand"  is  supplied  in 
response  to  MISSING  information,  while  “urine"  is  supplied  to  make  a 
general  concept  more  specific.  Ue  will  ignore  this  and  all  other 
inferences  net  needed  in  the  following  description.) 

At  the  point  the  reference  problem  is  undertaken,  the  state  of 
this  conceptua li rat  ion  is  the  following: 

(#10C*  Cl:  I  USA  Cl  //FLUID)  I 
C2:  I  (ISA  C2  //DIAPER) 

(*P0SS*  C2  C3:  I  USA  C2  //PERSON) 

(NAME  C3  "ANDY")!))) 

ie.  there  is  some  fluid  located  at  the  diaper  which  is  possessed  by  a 
person  whose  name  is  Andy.  Once  the  correct  "//ANDY"  has  been  identified, 
the  referent  of  "diaper"  can  be  establ  ishe.^^using  the  principle  that 
explicit  subproposi t ions  of  a  certain  class  (*P0SS*  among  these)  should 
appease  the  reference-f inding  mechanism.  That  is,  "The  diaper", 
occurring  out  of  context  with  no  conceptual  modification  is 
referrent i 3 1 ly  ambiguous,  while  "The  diaper  possessed  by  X"  is  a  signal 
to  MEMORY  that  the  speaker  has  included  what  he  feels  is  sufficient 
information  either  to  identify  or  create  the  token  of  a  diaper  being 
referenced.  However,  this  diaper  processing  must  wait  for  the  *P0SS* 
proposition  to  be  stored  in  MEMORY  and  this  in  turn  involves  the 
determination  of  reference  to  the  possessor  (the  problem  at  hand).  The 
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reference  to  #FIU10  is  simply  solved:  the  concept  #FLU 1 0  is  invoked  as 
part  of  the  definition  of  what  it  is  to  be  wet,  and  MEMORY  simply 
creates  a  token  of  this  mass-noun  concept.  MEMORY  realizes  that 
references  to  mass  nouns  frequently  occur  with  no  explicit  conceptual 
modification,  and  does  not  bother  to  identify  them  further  unless 
contradictory  inferences  result  from  them  later  on.  This  token  of  #FLUID 
stands  for  the  fluid  which  ic  currently  in  "Andy"’s  diaper.  Now  only  the 
person  referent  remains  to  be  solved. 

Using  its  standard  intersection  search,  MEMORY  uses  the  two 
descriptive  propositions  to  locate  MCI  and  MC2  as  possible  candidates 
for  the  referent  of  P.  Since  no  more  can  be  done  at  this  point,  MEMORY 
creates  a  concept,  MC3,  'which  will  turn  out  in  this  case  to  be 
temporary)  whose  occurence  set  (see  beginning  of  section  VI)  consists  of 
the  two  propositions  01  and  G2.  In  addition,  MEMORY  notes  that  this 
concept  has  beer  rreated  as  the  result  of  an  ambiguous  reference 
(specifically,  it  adds  MC3  to  the  list  ?  REFUNEST  A0l  I SHEO ) .  This  done,  a 
toKcn  us  =>  u  1  which  is  possessed  by  MC3  can  now  be  created.  This 
token  too,  oy  virtue  of  its  referencing  another  possibly  incorrectly 
identified  concept  in  MEMORY ,  will  be  subject  to  reference  reevalua* ion, 
pending  identification  of  HC3.  At  this  point,  MEMORY  has  an  internal 
form  of  the  conceptualization,  albeit  incomplete,  so  inferencing  begins. 

Of  interest  to  this  example  is  the  subproposition  “MC3  possesses  a 
diaper."  Subpropositions  are  briefly  discussed  in  section  VI.  13) 
describes  n  more  detail  the  methods  by  which  all  subproposi t ions  are 
extracted  for  exam iriaf i on  by  the  inference  mechanism.  In  this  example 
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we  nave  a  clear-cut  example  of  where  an  explicit-peripheral 
subproposi  t  ion  plays  a  major  part  in  the  understanding  of  the  ant  ire 
conceptualization:  one  inference  memory  can  make  from 

<*P0SS*  X:  I  (ISA  X  ^PERSON))  Y:  ((ISA  Y  #D1APER) } ) 

with  a  high  degree  of  certainty  is  that  the  possessor  is  an  infant; 
namely: 

(AGE  X  aORDtRHONTHS) 

(PUHUEfinOMTHS  i s  a  "fuzzy"  concept  which  will  match  any  duration  concept 
within  its  "fuzzy"  limits).  The  proposi  tion  (AGE  HC3  wQRDERMGNTh'S)  is 
therefore  added  to  f1C3's  occurence  set,  and  other  inferencing  proceeds. 
Eventually,  all  inferencing  will  die  out  or  be  stopped  by  depth 
controls.  At  that  point,  t1C3  is  detected  as  still  having  been 
unestablished,  so  reference  establishment  is  again  undertaken.  This 
time,  however,  new  information  is  available  which  resolves  the  conflicts 
the  AGE  predicate  is  recognized  as  matching  the  AGE  oropoeition  stored 
on  the  occurence  set  of  MCI.  ’1(33  has  thus  been  identified.  Its 
occurence  sat,  which  has  probably  been  augmented  by  other  inferences,  is 
then  merged  with  that  of  MU.  to  preserve  anu  additional  information 
communicated  by  the  input  or  its  inferences  and  HC3  is  purged.  Finally, 
all  subpropositions  of  the  original  input  are  resubmitted  to  the 
inferencer  in  hopes  of  generating  new  information  by  making  use  of  MCl’s 
now-accessabie  occurence  sot.  Duplicated  information  is  immediately 
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rejected  on  this  and  subsequent 
no  new  information  turns  up.  At 
are  communicated  externally  in 


passes.  This  procedure  is  repeated  until 
that  point,  any  unidentified  references 
the  form  “X  uho?"  or  "uhat  X?" 


£2 


BfEEBBffiES 


1.  Fillmore,  C. ,  ‘The  Case  for  Case*  in  Universale  in  Linguistic 

Theoru.  E.  Bach  and  R.  Harms  (eds.)  Holt,  Rinehart  and 
Uinstcn,  Neu  York.  13G8 

2.  Goldman,  N.,  ‘The  Generation  of  English  Sentences  from  a  Deep 

Conceptual  Base’,  Ph.Q.  thesis  Computer  Science  Dept., 
Stanford  Uni versi ty,  Stanford  Cal.  1973  (forthcoming) 

3.  Rieger,  C.,  ‘Conceptual  flemory’,  Ph.D.  thesis 

Computer  Science  Oept.,  Stanford  University 
Stanford,  Cal.  1973  (forthcoming) 

4.  Riesbeck,  C.,  ‘Computer  Analysis  of  Natural  Language  !n 

Context' ,  Ph.D.  thesis.  Computer  Science  Dept., 

Stanford  Un> versi ty,  Stanford,  Cal.  1973  (forthcoming) 

5.  Schank,  R. ,  ‘Conceptual  Dependency:  A  Theory  of  Natural 

Language  Understanding'  in  Cognitive  Psucholoau 
vo I  3  no  4  October  1372 

G.  Schank,  R. ,  ‘Semantics  in  Conceptual  Aralysis’  in  Lingua 
vo  I  30  ros  3  «S  4  1972 

7.  Schank,  R,  ,  'The  Fourteen  Primitive  Actions  and  Their 

inferences',  Stanford  A. !  Nemo  -183  ,  Computer  Science 
Oept.,  Stantor d  Uni versi  .y,  Stanford  Cal .  1973 

8.  Simmons,  R.  and  Slocum,  J. ,  ‘  Generating  English  Discourse 

From  Semantic  NetuorKs*,  in  Communications  of  the  ACM 
vol  IS  no  10  October  1972 

9.  Wilks,  V. ,  ‘An  Artificial  intelligence  Approach  to  flachine 

Translation',  in  Computer  Hodels  of  Thought 
and  Language.  R.  Schank  and  K.  Colby  (eds), 

W.H.  Freeman  &  Co.,  San  Francisco  1973 


G3 


